-- Logs begin at Wed 2022-06-15 09:03:05 UTC, end at Wed 2022-06-15 09:46:54 UTC. -- Jun 15 09:29:49.092330 dv-cinder-845178-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 15 09:29:49.105396 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 15 09:29:49.106610 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 09:29:49 2022] *** Jun 15 09:29:49.106610 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 09:29:49.106610 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 09:29:49.106610 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: nodename: dv-cinder-845178-6-iscsi Jun 15 09:29:49.106610 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: machine: x86_64 Jun 15 09:29:49.106610 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: clock source: unix Jun 15 09:29:49.106610 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: pcre jit disabled Jun 15 09:29:49.106610 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: detected number of CPU cores: 4 Jun 15 09:29:49.106610 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: current working directory: / Jun 15 09:29:49.106610 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: detected binary path: /usr/bin/uwsgi-core Jun 15 09:29:49.106610 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: your processes number limit is 47680 Jun 15 09:29:49.106610 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: your memory page size is 4096 bytes Jun 15 09:29:49.106610 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: detected max file descriptor number: 2048 Jun 15 09:29:49.106610 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: lock engine: pthread robust mutexes Jun 15 09:29:49.107315 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: thunder lock: enabled Jun 15 09:29:49.107315 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 15 09:29:49.107315 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 09:29:49.150338 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: Python main interpreter initialized at 0x5635dd1ac9c0 Jun 15 09:29:49.150338 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: python threads support enabled Jun 15 09:29:49.150338 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: your server socket listen backlog is limited to 100 connections Jun 15 09:29:49.150338 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: your mercy for graceful operations on workers is 90 seconds Jun 15 09:29:49.150758 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 09:29:49.150836 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: *** Operational MODE: preforking *** Jun 15 09:29:49.151062 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: *** uWSGI is running in multiple interpreter mode *** Jun 15 09:29:49.151062 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: spawned uWSGI master process (pid: 80309) Jun 15 09:29:49.151266 dv-cinder-845178-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 15 09:29:49.152493 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: spawned uWSGI worker 1 (pid: 80318, cores: 1) Jun 15 09:29:49.152493 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: spawned uWSGI worker 2 (pid: 80319, cores: 1) Jun 15 09:29:49.152493 dv-cinder-845178-6-iscsi devstack@keystone.service[80309]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 09:29:54.726036 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 09:29:54.726036 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: from cryptography.utils import int_from_bytes Jun 15 09:29:54.727347 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 09:29:54.727347 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: from cryptography.utils import int_from_bytes Jun 15 09:29:54.727456 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 09:29:54.727456 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: from cryptography.utils import int_from_bytes Jun 15 09:29:54.727456 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 09:29:54.727456 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: from cryptography.utils import int_from_bytes Jun 15 09:29:54.775781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 09:29:54.775954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 09:29:54.776149 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] command line args: [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 09:29:54.776258 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 09:29:54.776397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 09:29:54.776486 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 09:29:54.776563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ================================================================================ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 09:29:54.776633 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] command line args: [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 09:29:54.776821 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] admin_token = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.776907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 09:29:54.777020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ================================================================================ {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 09:29:54.777111 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] config_dir = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.777241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.777319 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] admin_token = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.777424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] config_source = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.777511 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] config_dir = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.777841 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] debug = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.777958 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.778037 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.778343 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] config_source = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.778343 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] debug = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.778572 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.778677 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.778797 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.778893 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.778993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.779099 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.779201 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.779295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.779404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.779503 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.779597 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_config_append = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.779697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.779798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.779900 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] log_config_append = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.779993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_dir = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.780091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.780190 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.780305 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] log_dir = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.780424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.780544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] log_file = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.780663 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.780777 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.780895 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.780980 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.781097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.781174 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.781295 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.781295 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.781486 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.781486 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.781676 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.781751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.781872 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.781948 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.782075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.782156 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.782228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.782296 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.782410 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.782512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.782617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.782718 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.782804 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.782956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.783053 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.783207 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.783294 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.783455 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.783733 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.783811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.783934 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] publish_errors = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.784169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.784295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.784398 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] publish_errors = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.784484 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.784576 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.784659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.784822 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.784947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.785022 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.785155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.785240 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.785453 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] standard_threads = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.785533 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.785695 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.785842 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] standard_threads = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.785917 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.786033 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.786108 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.786177 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.786272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] use_journal = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.786363 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.786441 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] use_json = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.786544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] use_journal = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.786624 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] use_stderr = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.786741 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] use_json = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.786825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] use_syslog = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.786898 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] use_stderr = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.787005 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] use_syslog = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.787088 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.787237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 09:29:54.787321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.787490 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.787567 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.787746 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.787856 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.788537 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.788615 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.788778 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.788857 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.789017 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.789095 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.789259 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.789343 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.789495 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.789574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.789734 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.789810 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.789979 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.790063 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.790225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.790309 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.790458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.790553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.790728 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.790816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.790965 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.791043 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.791203 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.791283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.791447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.791524 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.791670 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.791750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.791920 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.791996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.792176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.792254 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.792420 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.792505 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.792657 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.792735 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.792892 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.792974 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.793147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.793232 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.793399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.793482 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.793646 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.793730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.793880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.793958 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.794112 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.794189 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.794340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.794460 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.794586 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.794661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.794818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.794897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.795070 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.795155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.795298 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.795376 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.795530 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.795607 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.795759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.795848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.796007 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.796085 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.796240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.796317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.796481 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.796565 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.796707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.796809 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.796943 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.797026 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.797177 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.797330 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.797404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.797473 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.797623 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.797703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.797854 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.797946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.798083 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.798161 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.798315 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.798392 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.798574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.798693 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.798814 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.798893 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.799050 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.799128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.799280 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.799371 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.799511 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.799622 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.799745 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.799850 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.799980 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.800095 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.800193 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.800287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.800431 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.800513 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.800659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.800751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.800889 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.801019 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.801124 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.801202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.801357 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.801449 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.801587 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.801710 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.801817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.801896 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.802061 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.802151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.802297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.802383 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.802555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.802687 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.802798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.802874 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.803034 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.803126 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.803264 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.803344 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.803594 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.803685 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.803790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.803880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.804028 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.804107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.804284 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.804357 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.804525 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.804611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.804767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.804845 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.805009 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.805098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.805240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.805321 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.805474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.805553 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.805711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.805796 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.805946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.806032 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.806183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.806262 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.806419 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.806525 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.806683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.806787 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.806920 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.807004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.807151 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.807230 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.807387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.807467 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.807619 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.807697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.807854 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.807935 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.808112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.808192 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.808351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.808428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.808587 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.808665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.808814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.808888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.809051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.809131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.809286 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.809363 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.809521 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.809608 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.809750 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.809829 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.809981 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.810066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.810211 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.810289 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.810444 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.810572 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.810723 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.810817 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.810924 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.811005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.811170 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.812978 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.813093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.813258 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.813350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.813520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.813611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.813797 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.813877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.814069 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.814149 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.814325 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.814414 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.814591 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.external = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.814687 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.external = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.814851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.814937 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.815141 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.815263 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.815382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.815526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.815610 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.password = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.815683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.password = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.815863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.token = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.815949 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.token = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.816087 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.816169 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.816327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.816408 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.816616 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.816702 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.816851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.816938 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.817103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.817184 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.817351 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.817432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.817586 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.817669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.817823 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.817903 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.818073 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.818152 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.818320 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.818402 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.818593 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.818675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.818833 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.818912 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.819108 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.819193 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.819347 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.819428 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.819617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.819697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.819871 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.819954 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.820109 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.820190 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.820360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.820440 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.820645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.820735 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.820893 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.820974 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.821155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.821236 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.821398 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.821486 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.821657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.821745 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.821891 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.821971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.822131 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.822211 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.822374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.822453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.822649 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.822742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.822870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.822973 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.823117 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.823223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.823356 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.823444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.823608 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.823690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.823846 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.823926 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.824098 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.824185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.824335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.824416 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.824581 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.824660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.824817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.824896 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.825051 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.825127 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.825299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.825380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.825536 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.825625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.825772 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.825852 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.826023 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.826104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.826254 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.826343 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.826490 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.826619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.826762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.826843 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.827016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.827105 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.827249 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.827328 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.827482 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.827641 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.827718 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.827800 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.827945 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.828026 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.828193 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.828274 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.828439 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.828528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.828694 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.828775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.828937 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.829017 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.829208 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.829297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.829446 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.829526 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.829680 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.829759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.829911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.829999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.830145 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.830226 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.830376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.830457 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.830635 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.830731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.830875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.830956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.831114 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.831194 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.831359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.831448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.831591 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.831671 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.831838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.831918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.832088 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.832177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.832321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.832401 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.832570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.832649 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.832815 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.832903 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.833046 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.833126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.833282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.833362 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.833511 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.833599 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.833746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.833832 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.833982 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.834062 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.834224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.834312 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.834460 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.835086 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.835240 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.835322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.835492 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.835585 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.835777 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.835859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.836009 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.836089 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.836240 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.836329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.836488 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.836570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.836737 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.836817 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.836970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.837058 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.837226 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.837313 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.837440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.837520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.837669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.837758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.837907 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.837987 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.838166 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.838248 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.838397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.838485 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.838668 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.838749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.838914 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.838994 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.839157 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.839238 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.839390 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.839471 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.839622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.839702 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.839854 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.839936 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.840090 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.840169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.840323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.840404 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.840554 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.840639 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.840797 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.840877 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.841043 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.841123 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.841286 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.841367 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.841531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.841612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.841777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.841857 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.842007 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.842088 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.842250 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.842340 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.842487 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.842626 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.842749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.842832 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.842982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.843062 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.843218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.843298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.843462 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.843544 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.843707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.843786 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.843944 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.844025 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.844196 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.844279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.844427 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.844506 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.844668 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.844746 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.844903 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.844984 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.845137 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.845216 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.845373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.845453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.845618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.845700 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.845857 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.845938 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.846084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.846163 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.846320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.846401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.846582 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.846666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.846836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.846917 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.847085 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.847167 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.847318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.847397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.847567 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.847646 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.847816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.847897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.848055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.848135 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.848301 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.848381 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.848532 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.848607 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.848764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.848845 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.848999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] role.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.849079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] role.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.849244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] role.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.849332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] role.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.849475 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.849555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.849722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.849801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.849969 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.850051 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.850215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.850324 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.851039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.851124 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.851289 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.851385 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.851533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.851632 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.851779 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.851873 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.852023 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.852104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.852255 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.852337 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.852502 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.852590 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.852750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.852832 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.852993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.853073 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.853239 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.853328 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.853672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.853754 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.853909 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.853988 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.854159 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.854247 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.854405 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.854485 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.854678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.854759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.854929 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.855023 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.855162 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.855242 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.855417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.855496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.855667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.855756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.855908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.855987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.856136 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.856216 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.856368 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.856458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.856599 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.856679 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.856847 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.856927 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.857102 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.857184 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.857350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.857430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.857587 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.857668 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.857826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.857907 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.858056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.858135 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.858292 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.858372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.858550 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.858636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.858802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.858883 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.859039 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.859118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.859290 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.859372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.859539 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.859626 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.859777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.859872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.860021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.860109 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.860264 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.860344 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.860510 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.860590 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.860746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.860829 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.860983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.861063 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.861216 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.861297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.861462 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.861544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.861710 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.861789 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.861936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.862015 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.862178 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.862259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.862473 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.862619 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.862762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.862896 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.connection = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.863030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.863158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.863278 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.863404 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.863524 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.863641 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.863759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.863876 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.863993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.864119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.864238 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.864355 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.864472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.864589 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.864707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.864837 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.864958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.865075 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.865193 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.865310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.865428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.865554 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.865673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.865790 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.865910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.866027 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.866145 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.866270 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.866389 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.866568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.866694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.866812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.866930 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.867060 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.867194 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.867366 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 09:29:54.867488 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 09:29:54.867606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 09:29:54.983833 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:54.984052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:54.984274 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:54.984572 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:54.984809 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:54.985039 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:54.992629 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:54.993677 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.022880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.023105 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.028788 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.029170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.078657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.078824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.126949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.127178 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.127651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.127890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.194920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.195156 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.195303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.195421 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.195539 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.195624 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.195766 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.195850 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.195979 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.196075 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.196199 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.196418 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.219374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.219638 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.219744 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.219868 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.219954 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.220093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.220176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.220312 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.220397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.220528 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.220612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.220744 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.220825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.220963 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.231908 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.232206 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.245042 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.245269 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.245489 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.245710 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.245793 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.245927 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.246010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.246142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.246227 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.246354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.246446 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.246606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.246826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.247043 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 09:29:55.263955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.264163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 09:29:55.264247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.264382 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 09:29:55.264481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.264687 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 09:29:55.264769 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.264914 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 09:29:55.265141 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.265367 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.265464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.265637 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.265718 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.265901 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.265982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.266166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.276781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.277054 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.277325 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.277855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.277959 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.278155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.278430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.278739 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.285928 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.286838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.289359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.289637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.289913 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.290188 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.290270 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.290465 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.290575 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.290751 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.290834 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.291017 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.291112 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.291285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.291368 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.291549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.291636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.291814 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.291904 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.292077 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.292159 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.292373 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.292646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.292913 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.318954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.320413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.321078 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.321353 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.322034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.322323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.326621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.326900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.327178 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.327638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.327921 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.328201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.334732 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.334962 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.335705 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.335989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.339429 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.339713 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.339991 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.340274 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.340488 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.340574 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.340779 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.340862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.341052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.341133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.341316 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.341400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.341596 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.341873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.342146 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.342416 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.360096 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.360379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.361219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.361509 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.364936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.366636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.369311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.369612 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.370289 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.370614 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.374767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.375771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.378382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.379404 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.382730 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.383026 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.383308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.383591 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.383678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.383865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.383963 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.384140 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.384224 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.384453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.384734 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.385015 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.403428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.403711 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.403977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.404237 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.404415 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.404701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.404970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.405234 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.412086 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.413136 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.413811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.414093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.414882 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.415164 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.417139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.417430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.418217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.418521 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.419161 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.419474 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.419760 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.420239 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.420548 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.420835 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.433618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.433903 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.434195 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.434477 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.434756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.434856 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.435039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.435123 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.435310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.435395 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.435620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.435904 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.436192 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.436471 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.454264 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.455493 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.457614 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.458836 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.461002 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.462198 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.462625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.463837 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.464400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.464676 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.464972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.465620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.465904 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.466188 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.472259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.473477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.473870 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.475133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.477148 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.477435 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.477718 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.477989 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.478423 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.478737 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.479023 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.479300 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.487316 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.487602 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.487880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.488699 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.488988 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.489268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.496234 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.496520 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.496798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.497072 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.497342 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.497639 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.497792 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 09:29:55.497908 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.498003 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.498181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.498265 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.498454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.498555 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.498787 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.498871 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.499078 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.499170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.499355 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.499441 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.499624 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.499705 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.499883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.499974 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.500253 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.500527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.500806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.501076 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.501340 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 09:29:55.538223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5635dd1ac9c0 pid: 80319 (default app) Jun 15 09:29:55.542734 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5635dd1ac9c0 pid: 80318 (default app) Jun 15 09:29:55.542846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79376e-c0b1-4c5d-8bd5-bf0d84b3083c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:29:55.542846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79376e-c0b1-4c5d-8bd5-bf0d84b3083c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:29:55.542846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79376e-c0b1-4c5d-8bd5-bf0d84b3083c None None] PATH_INFO: `/v3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:29:55.546622 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Wed Jun 15 09:29:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:03.452294 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bc16d-1964-4d2e-9001-d4f515e186f3 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:03.452869 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bc16d-1964-4d2e-9001-d4f515e186f3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:03.452869 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bc16d-1964-4d2e-9001-d4f515e186f3 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:03.457283 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:30:03.462649 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e21e1-c01a-4936-8a55-237ec5424522 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:03.463043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e21e1-c01a-4936-8a55-237ec5424522 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:03.463215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e21e1-c01a-4936-8a55-237ec5424522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:03.532290 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: INFO dbcounter [None req-4b6e21e1-c01a-4936-8a55-237ec5424522 None None] Registered counter for database keystone Jun 15 09:30:03.553828 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG oslo_db.sqlalchemy.engines [None req-4b6e21e1-c01a-4936-8a55-237ec5424522 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 09:30:03.560048 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writer thread running {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 09:30:03.743897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG passlib.handlers.bcrypt [None req-4b6e21e1-c01a-4936-8a55-237ec5424522 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80319) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 15 09:30:03.744331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG passlib.handlers.bcrypt [None req-4b6e21e1-c01a-4936-8a55-237ec5424522 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80319) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 15 09:30:03.801493 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4b6e21e1-c01a-4936-8a55-237ec5424522 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:03.803230 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4b6e21e1-c01a-4936-8a55-237ec5424522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:03.934973 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 15 09:30:04.100753 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bc16d-1964-4d2e-9001-d4f515e186f3 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:04.178512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: INFO dbcounter [None req-fa4bc16d-1964-4d2e-9001-d4f515e186f3 None None] Registered counter for database keystone Jun 15 09:30:04.198281 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG oslo_db.sqlalchemy.engines [None req-fa4bc16d-1964-4d2e-9001-d4f515e186f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 09:30:04.204541 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writer thread running {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 09:30:04.325980 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bc16d-1964-4d2e-9001-d4f515e186f3 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:04.330311 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac007e-f485-4220-848b-f1df3d1e3b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50595d3c5444c94b0150144dff96117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:04.331035 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac007e-f485-4220-848b-f1df3d1e3b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:04.331329 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac007e-f485-4220-848b-f1df3d1e3b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:04.331614 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac007e-f485-4220-848b-f1df3d1e3b9d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:04.340245 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac007e-f485-4220-848b-f1df3d1e3b9d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:04.393391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: WARNING keystone.common.rbac_enforcer.enforcer [None req-81ac007e-f485-4220-848b-f1df3d1e3b9d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 15 09:30:04.393659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac007e-f485-4220-848b-f1df3d1e3b9d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:04.404395 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Wed Jun 15 09:30:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 09:30:04.410350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e21e1-c01a-4936-8a55-237ec5424522 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:04.427974 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e21e1-c01a-4936-8a55-237ec5424522 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:04.432488 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c28e0e-31c5-45bf-87e3-68a76e315c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50595d3c5444c94b0150144dff96117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:04.433610 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c28e0e-31c5-45bf-87e3-68a76e315c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:04.433903 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c28e0e-31c5-45bf-87e3-68a76e315c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:04.434188 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c28e0e-31c5-45bf-87e3-68a76e315c54 admin admin] PATH_INFO: `/v3/projects/a50595d3c5444c94b0150144dff96117` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:04.435746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c28e0e-31c5-45bf-87e3-68a76e315c54 admin admin] RBAC: Authorizing `identity:get_project(project_id=a50595d3c5444c94b0150144dff96117)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:04.486475 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b7c28e0e-31c5-45bf-87e3-68a76e315c54 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 15 09:30:04.487077 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c28e0e-31c5-45bf-87e3-68a76e315c54 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:04.492071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Wed Jun 15 09:30:04 2022] GET /identity/v3/projects/a50595d3c5444c94b0150144dff96117 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:06.595136 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4ca6b-9732-4130-86ab-3d246e59b9c7 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:06.595617 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4ca6b-9732-4130-86ab-3d246e59b9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:06.595715 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4ca6b-9732-4130-86ab-3d246e59b9c7 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:06.600392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:06.605754 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f0640-d0a9-446c-abb7-bb49eeb756af None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:06.606115 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f0640-d0a9-446c-abb7-bb49eeb756af None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:06.606329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f0640-d0a9-446c-abb7-bb49eeb756af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:06.624833 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b65f0640-d0a9-446c-abb7-bb49eeb756af None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:06.626361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b65f0640-d0a9-446c-abb7-bb49eeb756af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:06.634256 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 15 09:30:06.657044 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4ca6b-9732-4130-86ab-3d246e59b9c7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:06.669619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4ca6b-9732-4130-86ab-3d246e59b9c7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:06.673843 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c77ff8-05be-42b8-9c60-814274ac762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50595d3c5444c94b0150144dff96117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:06.674479 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c77ff8-05be-42b8-9c60-814274ac762d admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:06.674799 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c77ff8-05be-42b8-9c60-814274ac762d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:06.675086 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c77ff8-05be-42b8-9c60-814274ac762d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:06.682870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c77ff8-05be-42b8-9c60-814274ac762d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:06.684652 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c77ff8-05be-42b8-9c60-814274ac762d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:06.693443 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Wed Jun 15 09:30:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 09:30:06.698604 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f0640-d0a9-446c-abb7-bb49eeb756af None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:06.707583 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f0640-d0a9-446c-abb7-bb49eeb756af None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:06.712512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15bc6c-ccd6-4afa-b0bd-b9e73d2d081e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50595d3c5444c94b0150144dff96117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:06.713373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15bc6c-ccd6-4afa-b0bd-b9e73d2d081e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:06.713663 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15bc6c-ccd6-4afa-b0bd-b9e73d2d081e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:06.713946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15bc6c-ccd6-4afa-b0bd-b9e73d2d081e admin admin] PATH_INFO: `/v3/users/99cee851d5f84c3782ff1a60b5667a3d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:06.715382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15bc6c-ccd6-4afa-b0bd-b9e73d2d081e admin admin] RBAC: Authorizing `identity:get_user(user_id=99cee851d5f84c3782ff1a60b5667a3d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:06.717217 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15bc6c-ccd6-4afa-b0bd-b9e73d2d081e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:06.718804 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Wed Jun 15 09:30:06 2022] GET /identity/v3/users/99cee851d5f84c3782ff1a60b5667a3d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:08.907271 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875f400-6eeb-4069-a434-b54b43eb0df2 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:08.907771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875f400-6eeb-4069-a434-b54b43eb0df2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:08.907771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875f400-6eeb-4069-a434-b54b43eb0df2 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:08.909111 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:08.914529 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985652b0-66d9-425e-a39a-e5d93706ac2b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:08.914975 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985652b0-66d9-425e-a39a-e5d93706ac2b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:08.915115 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985652b0-66d9-425e-a39a-e5d93706ac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:08.932742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-985652b0-66d9-425e-a39a-e5d93706ac2b None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:08.933953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-985652b0-66d9-425e-a39a-e5d93706ac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:08.934300 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566af27-6bdf-4463-83c0-22f125a236ee None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:08.934621 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566af27-6bdf-4463-83c0-22f125a236ee None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:08.934906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566af27-6bdf-4463-83c0-22f125a236ee None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:08.936248 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:08.946344 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f26af8-7bc6-4375-a160-c426c59b0d68 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:08.946673 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f26af8-7bc6-4375-a160-c426c59b0d68 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:08.946954 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f26af8-7bc6-4375-a160-c426c59b0d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:08.987699 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG passlib.handlers.bcrypt [None req-79f26af8-7bc6-4375-a160-c426c59b0d68 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80318) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 15 09:30:08.988143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG passlib.handlers.bcrypt [None req-79f26af8-7bc6-4375-a160-c426c59b0d68 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80318) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 15 09:30:09.020693 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:09.034435 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-79f26af8-7bc6-4375-a160-c426c59b0d68 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:09.036124 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-79f26af8-7bc6-4375-a160-c426c59b0d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:09.044120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985652b0-66d9-425e-a39a-e5d93706ac2b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:09.069769 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:09.142924 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:09.156685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985652b0-66d9-425e-a39a-e5d93706ac2b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:09.165616 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f26af8-7bc6-4375-a160-c426c59b0d68 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:09.192118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b3b90-1328-4273-a7c9-abe15eadfc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:09.192952 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b3b90-1328-4273-a7c9-abe15eadfc5a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:09.193237 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b3b90-1328-4273-a7c9-abe15eadfc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:09.193514 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b3b90-1328-4273-a7c9-abe15eadfc5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:09.208597 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b3b90-1328-4273-a7c9-abe15eadfc5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-849b3b90-1328-4273-a7c9-abe15eadfc5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:09.220433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:09.221466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:09.222307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:09.222307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:09.222307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:09.222307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:09.222307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:09.222307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:09.222307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:09.222307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:09.222307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:09.222307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:09.222307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:09.222307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:30:09.222307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:30:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:30:09.228136 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b3b90-1328-4273-a7c9-abe15eadfc5a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:09.280595 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f26af8-7bc6-4375-a160-c426c59b0d68 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:09.283045 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:09.321717 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:09.326038 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c407194-3ebe-4385-9470-7d1629a768db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:09.327007 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c407194-3ebe-4385-9470-7d1629a768db None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:09.327302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c407194-3ebe-4385-9470-7d1629a768db None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:09.327585 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c407194-3ebe-4385-9470-7d1629a768db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:09.343838 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b3b90-1328-4273-a7c9-abe15eadfc5a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:09.384705 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b103c-6592-45af-8134-cd38433010c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:09.385384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b103c-6592-45af-8134-cd38433010c3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:09.385696 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b103c-6592-45af-8134-cd38433010c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:09.385955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b103c-6592-45af-8134-cd38433010c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:09.386742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b103c-6592-45af-8134-cd38433010c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:09.387052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b103c-6592-45af-8134-cd38433010c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:09.388812 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b103c-6592-45af-8134-cd38433010c3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:09.401725 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:09.406933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c407194-3ebe-4385-9470-7d1629a768db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:09.407292 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b103c-6592-45af-8134-cd38433010c3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:09.407402 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c407194-3ebe-4385-9470-7d1629a768db None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:09.519166 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b103c-6592-45af-8134-cd38433010c3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:09.522783 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 09:30:09.529500 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c407194-3ebe-4385-9470-7d1629a768db None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:09.534400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:09.574329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34238227-7b2c-407b-a8bc-71c9a2663538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:09.575246 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34238227-7b2c-407b-a8bc-71c9a2663538 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:09.575528 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34238227-7b2c-407b-a8bc-71c9a2663538 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:09.575806 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34238227-7b2c-407b-a8bc-71c9a2663538 None admin] PATH_INFO: `/v3/users/99cee851d5f84c3782ff1a60b5667a3d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:09.577037 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34238227-7b2c-407b-a8bc-71c9a2663538 None admin] RBAC: Authorizing `identity:get_user(user_id=99cee851d5f84c3782ff1a60b5667a3d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:09.578517 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34238227-7b2c-407b-a8bc-71c9a2663538 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:09.580171 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:09 2022] GET /identity/v3/users/99cee851d5f84c3782ff1a60b5667a3d => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:09.586084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34238227-7b2c-407b-a8bc-71c9a2663538 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:09.601250 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:09.639197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c407194-3ebe-4385-9470-7d1629a768db None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:09.675974 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6f567-0f23-4636-8752-c763205ab3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:09.676804 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6f567-0f23-4636-8752-c763205ab3ea None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:09.677091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6f567-0f23-4636-8752-c763205ab3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:09.677372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6f567-0f23-4636-8752-c763205ab3ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:09.689067 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34238227-7b2c-407b-a8bc-71c9a2663538 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:09.695376 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6f567-0f23-4636-8752-c763205ab3ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:09.696853 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6f567-0f23-4636-8752-c763205ab3ea None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:09.717420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9ff6f567-0f23-4636-8752-c763205ab3ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:30:09.717420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:09.717420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:09.717420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:09.717420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:09.717420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:09.717420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:09.717420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:09.717420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:09.717420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:09.717420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:09.717420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:09.717420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:30:09.717420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:30:09.717420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:09.718268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:09.719247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:30:09.719247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:30:09.719247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:30:09.719247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:09.719247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:30:09.724404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36495f2-3359-40d2-9fda-5fce147e0e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:09.724942 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6f567-0f23-4636-8752-c763205ab3ea None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:09.725216 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36495f2-3359-40d2-9fda-5fce147e0e5f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:09.725501 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36495f2-3359-40d2-9fda-5fce147e0e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:09.725776 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36495f2-3359-40d2-9fda-5fce147e0e5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:09.726993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36495f2-3359-40d2-9fda-5fce147e0e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:09.728453 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36495f2-3359-40d2-9fda-5fce147e0e5f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:09.730074 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:30:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:09.736117 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36495f2-3359-40d2-9fda-5fce147e0e5f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:09.788235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:09.819014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:09.837414 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6f567-0f23-4636-8752-c763205ab3ea None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:09.840551 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36495f2-3359-40d2-9fda-5fce147e0e5f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:09.875797 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578854a-97a2-4f69-b068-5c1078c083c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:09.876461 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578854a-97a2-4f69-b068-5c1078c083c8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:09.876747 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578854a-97a2-4f69-b068-5c1078c083c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:09.877832 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578854a-97a2-4f69-b068-5c1078c083c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:09.877832 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578854a-97a2-4f69-b068-5c1078c083c8 None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.domain.id=default, user.id=99cee851d5f84c3782ff1a60b5667a3d) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:09.878154 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578854a-97a2-4f69-b068-5c1078c083c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:09.882712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578854a-97a2-4f69-b068-5c1078c083c8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:09.886866 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 11/20] 10.222.0.45 () {56 vars in 1322 bytes} [Wed Jun 15 09:30:09 2022] GET /identity/v3/role_assignments?user.id=99cee851d5f84c3782ff1a60b5667a3d&scope.domain.id=default&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:09.887146 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61195673-0892-4829-8c69-d32b8a99cb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:09.887823 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61195673-0892-4829-8c69-d32b8a99cb61 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:09.888113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61195673-0892-4829-8c69-d32b8a99cb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:09.888397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61195673-0892-4829-8c69-d32b8a99cb61 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:09.889136 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61195673-0892-4829-8c69-d32b8a99cb61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:09.889449 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61195673-0892-4829-8c69-d32b8a99cb61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:09.890917 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61195673-0892-4829-8c69-d32b8a99cb61 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:09.916948 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 10/21] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:12.354550 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1498e82-7654-4bff-95a5-f30b6144f363 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:12.354550 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1498e82-7654-4bff-95a5-f30b6144f363 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:12.354550 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1498e82-7654-4bff-95a5-f30b6144f363 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:12.356827 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 12/22] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:12.362624 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb42ca2-a5cb-4d8a-84d2-6491bd16ed5b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:12.363534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb42ca2-a5cb-4d8a-84d2-6491bd16ed5b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:12.364570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb42ca2-a5cb-4d8a-84d2-6491bd16ed5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:12.387850 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-fbb42ca2-a5cb-4d8a-84d2-6491bd16ed5b None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:12.389403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-fbb42ca2-a5cb-4d8a-84d2-6491bd16ed5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:12.507909 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 11/23] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:12.553123 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1498e82-7654-4bff-95a5-f30b6144f363 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:12.716246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db2f09-586c-425f-ac96-4453fed50a0c None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:12.716569 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db2f09-586c-425f-ac96-4453fed50a0c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:12.716738 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db2f09-586c-425f-ac96-4453fed50a0c None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:12.718102 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 12/24] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:12.740170 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d645b-2946-408b-9cc0-7eed4fa105ed None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:12.740393 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d645b-2946-408b-9cc0-7eed4fa105ed None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:12.740851 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d645b-2946-408b-9cc0-7eed4fa105ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:12.769528 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1498e82-7654-4bff-95a5-f30b6144f363 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:12.818092 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-4d4d645b-2946-408b-9cc0-7eed4fa105ed None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:12.819412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4d4d645b-2946-408b-9cc0-7eed4fa105ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:12.884765 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f0c06-27d2-45a9-98be-9c961ffc0f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:12.884765 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f0c06-27d2-45a9-98be-9c961ffc0f6b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:12.884765 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f0c06-27d2-45a9-98be-9c961ffc0f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:12.885120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f0c06-27d2-45a9-98be-9c961ffc0f6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:12.921323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f0c06-27d2-45a9-98be-9c961ffc0f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-af4f0c06-27d2-45a9-98be-9c961ffc0f6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:12.937826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:12.938844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:12.939650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:12.939650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:12.939650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:12.939650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:12.939650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:12.939650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:12.939650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:12.939650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:12.939650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:12.939650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:12.939650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:12.939650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:30:12.942700 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 13/25] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:30:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:12.953204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f0c06-27d2-45a9-98be-9c961ffc0f6b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:12.961761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:12.975753 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:13.074613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 13/26] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:13.083877 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f645bd-c916-448a-801c-86e1f30695ed None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:13.084639 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f645bd-c916-448a-801c-86e1f30695ed None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:13.085283 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f645bd-c916-448a-801c-86e1f30695ed None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:13.091664 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 14/27] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:13 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:13.104725 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce141ecd-6a59-401b-bdb1-0a999b5fc790 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:13.105586 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce141ecd-6a59-401b-bdb1-0a999b5fc790 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:13.106351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce141ecd-6a59-401b-bdb1-0a999b5fc790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:13.170525 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ce141ecd-6a59-401b-bdb1-0a999b5fc790 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:13.170525 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ce141ecd-6a59-401b-bdb1-0a999b5fc790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:13.328212 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f0c06-27d2-45a9-98be-9c961ffc0f6b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:13.376515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 15/28] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:13.378471 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce141ecd-6a59-401b-bdb1-0a999b5fc790 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:13.447310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e73d2-795b-46b5-ae56-99c7067d3ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:13.448667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e73d2-795b-46b5-ae56-99c7067d3ddf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:13.449177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e73d2-795b-46b5-ae56-99c7067d3ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:13.449661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e73d2-795b-46b5-ae56-99c7067d3ddf None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:13.450683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e73d2-795b-46b5-ae56-99c7067d3ddf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:13.451212 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e73d2-795b-46b5-ae56-99c7067d3ddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:13.452829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e73d2-795b-46b5-ae56-99c7067d3ddf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:13.467192 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 14/29] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 515 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:13.473724 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd506331-d00a-4fe4-be7a-85bca8c2dc17 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:13.474656 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd506331-d00a-4fe4-be7a-85bca8c2dc17 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:13.475500 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd506331-d00a-4fe4-be7a-85bca8c2dc17 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:13.489989 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 15/30] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:13 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:13.491942 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd506331-d00a-4fe4-be7a-85bca8c2dc17 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:13.680899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce141ecd-6a59-401b-bdb1-0a999b5fc790 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:13.707237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:13.732042 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:13.803719 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64cb24-ee37-4ce5-9d7d-c8dc4b3c9a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:13.807122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64cb24-ee37-4ce5-9d7d-c8dc4b3c9a4f None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:13.808610 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64cb24-ee37-4ce5-9d7d-c8dc4b3c9a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:13.810047 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64cb24-ee37-4ce5-9d7d-c8dc4b3c9a4f None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:13.811396 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64cb24-ee37-4ce5-9d7d-c8dc4b3c9a4f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:13.815465 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64cb24-ee37-4ce5-9d7d-c8dc4b3c9a4f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:13.819558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd506331-d00a-4fe4-be7a-85bca8c2dc17 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:14.004068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6404c-6f59-4515-a744-4e77a6b6d257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:14.004751 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6404c-6f59-4515-a744-4e77a6b6d257 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:14.005038 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6404c-6f59-4515-a744-4e77a6b6d257 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:14.005321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6404c-6f59-4515-a744-4e77a6b6d257 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:14.008774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6404c-6f59-4515-a744-4e77a6b6d257 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:14.012404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6404c-6f59-4515-a744-4e77a6b6d257 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:14.073571 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 16/31] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Jun 15 09:30:13 2022] POST /identity/v3/roles => generated 219 bytes in 688 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:30:14.073571 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64cb24-ee37-4ce5-9d7d-c8dc4b3c9a4f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:14.200692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64cb24-ee37-4ce5-9d7d-c8dc4b3c9a4f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:14.263435 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45d8e9-910c-4bfb-807d-ef11cfdf3f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:14.270945 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45d8e9-910c-4bfb-807d-ef11cfdf3f6f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:14.271427 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45d8e9-910c-4bfb-807d-ef11cfdf3f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:14.272362 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45d8e9-910c-4bfb-807d-ef11cfdf3f6f None admin] PATH_INFO: `/v3/users/99cee851d5f84c3782ff1a60b5667a3d` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:14.283081 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45d8e9-910c-4bfb-807d-ef11cfdf3f6f None admin] RBAC: Authorizing `identity:get_user(user_id=99cee851d5f84c3782ff1a60b5667a3d)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:14.286324 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45d8e9-910c-4bfb-807d-ef11cfdf3f6f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:14.288643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 17/32] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:14 2022] GET /identity/v3/users/99cee851d5f84c3782ff1a60b5667a3d => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:14.294669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a8cb2-d284-41bb-9479-073f89c7dfb0 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:14.294808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a8cb2-d284-41bb-9479-073f89c7dfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:14.296101 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a8cb2-d284-41bb-9479-073f89c7dfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:14.311763 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 16/33] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Jun 15 09:30:13 2022] POST /identity/v3/roles => generated 225 bytes in 811 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:30:14.312471 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07289b6-fd56-49af-b5a3-339ae569337a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:14.312770 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07289b6-fd56-49af-b5a3-339ae569337a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:14.313056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07289b6-fd56-49af-b5a3-339ae569337a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:14.314438 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 17/34] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:14.324049 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef235b-9bcd-43f7-83ab-ca5369b85bb3 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:14.324345 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef235b-9bcd-43f7-83ab-ca5369b85bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:14.324633 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef235b-9bcd-43f7-83ab-ca5369b85bb3 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:14.326034 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 18/35] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:14.329300 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-778a8cb2-d284-41bb-9479-073f89c7dfb0 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:14.330925 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef235b-9bcd-43f7-83ab-ca5369b85bb3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:14.331233 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-778a8cb2-d284-41bb-9479-073f89c7dfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:14.387231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:14.472459 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 18/36] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:14.474779 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413fd4f-b214-4831-9b99-a690dca25da5 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:14.475306 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413fd4f-b214-4831-9b99-a690dca25da5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:14.475818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413fd4f-b214-4831-9b99-a690dca25da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:14.507004 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2413fd4f-b214-4831-9b99-a690dca25da5 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:14.508192 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2413fd4f-b214-4831-9b99-a690dca25da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:14.513897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef235b-9bcd-43f7-83ab-ca5369b85bb3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:14.554153 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:14.570580 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83995986-edf4-4d0b-8c3f-821d80f08a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:14.571337 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83995986-edf4-4d0b-8c3f-821d80f08a17 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:14.571628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83995986-edf4-4d0b-8c3f-821d80f08a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:14.571903 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83995986-edf4-4d0b-8c3f-821d80f08a17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:14.573203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83995986-edf4-4d0b-8c3f-821d80f08a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:14.574809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83995986-edf4-4d0b-8c3f-821d80f08a17 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:14.576517 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 19/37] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:30:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:14.577601 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e106f-4581-45af-835c-211a2161e6bc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:14.577891 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e106f-4581-45af-835c-211a2161e6bc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:14.578172 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e106f-4581-45af-835c-211a2161e6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:14.596784 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-de6e106f-4581-45af-835c-211a2161e6bc None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:14.598912 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-de6e106f-4581-45af-835c-211a2161e6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:14.600355 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 19/38] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:14.602697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413fd4f-b214-4831-9b99-a690dca25da5 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:14.683398 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 20/39] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:14.684357 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e106f-4581-45af-835c-211a2161e6bc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:14.724633 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:14.731101 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413fd4f-b214-4831-9b99-a690dca25da5 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:14.797483 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e106f-4581-45af-835c-211a2161e6bc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:14.824077 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:14.837066 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f27ea4-21bf-4582-8ff5-b7885342353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:14.837960 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f27ea4-21bf-4582-8ff5-b7885342353f None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:14.838251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f27ea4-21bf-4582-8ff5-b7885342353f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:14.838573 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f27ea4-21bf-4582-8ff5-b7885342353f None admin] PATH_INFO: `/v3/domains/default/users/99cee851d5f84c3782ff1a60b5667a3d/roles/efaf387c51e14931820f2a9b33ac5175` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:14.840679 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f27ea4-21bf-4582-8ff5-b7885342353f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=99cee851d5f84c3782ff1a60b5667a3d, role_id=efaf387c51e14931820f2a9b33ac5175)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:14.842177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f27ea4-21bf-4582-8ff5-b7885342353f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:14.858717 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 21/40] 10.222.0.45 () {58 vars in 1361 bytes} [Wed Jun 15 09:30:14 2022] PUT /identity/v3/domains/default/users/99cee851d5f84c3782ff1a60b5667a3d/roles/efaf387c51e14931820f2a9b33ac5175 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:30:14.859565 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f27ea4-21bf-4582-8ff5-b7885342353f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:14.879814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f74bd-d119-4fa6-b5f1-4ff3a73fec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:14.880782 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f74bd-d119-4fa6-b5f1-4ff3a73fec89 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:14.881229 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f74bd-d119-4fa6-b5f1-4ff3a73fec89 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:14.881761 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f74bd-d119-4fa6-b5f1-4ff3a73fec89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:14.897027 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f74bd-d119-4fa6-b5f1-4ff3a73fec89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:14.899137 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f74bd-d119-4fa6-b5f1-4ff3a73fec89 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:14.918813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a18f74bd-d119-4fa6-b5f1-4ff3a73fec89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:30:14.918813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:14.918813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:14.918813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:14.918813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:14.918813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:14.918813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:14.918813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:14.918813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:14.918813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:14.918813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:14.918813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:14.918813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:30:14.918813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:30:14.918813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:14.919714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:14.920551 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:30:14.920551 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:30:14.920551 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:30:14.920551 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:14.920551 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 20/41] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:14.921403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f74bd-d119-4fa6-b5f1-4ff3a73fec89 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:14.991898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f27ea4-21bf-4582-8ff5-b7885342353f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:15.032643 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8afa94-aa5b-4332-9b4b-07bf0ada5d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:15.033463 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8afa94-aa5b-4332-9b4b-07bf0ada5d94 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:15.033750 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8afa94-aa5b-4332-9b4b-07bf0ada5d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:15.034027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8afa94-aa5b-4332-9b4b-07bf0ada5d94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:15.036780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8afa94-aa5b-4332-9b4b-07bf0ada5d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:15.038265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8afa94-aa5b-4332-9b4b-07bf0ada5d94 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:15.040024 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 22/42] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:30:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:15.042182 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8afa94-aa5b-4332-9b4b-07bf0ada5d94 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:15.054150 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f74bd-d119-4fa6-b5f1-4ff3a73fec89 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:15.096105 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509b23f-17b7-46fa-bd53-10ac8fc39566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:15.097028 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509b23f-17b7-46fa-bd53-10ac8fc39566 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:15.097318 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509b23f-17b7-46fa-bd53-10ac8fc39566 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:15.097605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509b23f-17b7-46fa-bd53-10ac8fc39566 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:15.098962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509b23f-17b7-46fa-bd53-10ac8fc39566 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:15.100393 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509b23f-17b7-46fa-bd53-10ac8fc39566 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:15.106045 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:15.115477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 21/43] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Jun 15 09:30:14 2022] POST /identity/v3/roles => generated 223 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:30:15.116508 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509b23f-17b7-46fa-bd53-10ac8fc39566 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:15.126790 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:15.200751 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8afa94-aa5b-4332-9b4b-07bf0ada5d94 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:15.255303 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536f326-5640-4900-8e20-94c19751aa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:15.256515 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536f326-5640-4900-8e20-94c19751aa97 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:15.257022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536f326-5640-4900-8e20-94c19751aa97 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:15.257507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536f326-5640-4900-8e20-94c19751aa97 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:15.258052 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509b23f-17b7-46fa-bd53-10ac8fc39566 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:15.258749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536f326-5640-4900-8e20-94c19751aa97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:15.259286 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536f326-5640-4900-8e20-94c19751aa97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:15.262359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536f326-5640-4900-8e20-94c19751aa97 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:15.292960 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 23/44] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:15.300423 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536f326-5640-4900-8e20-94c19751aa97 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:15.309929 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5f81f-ec7f-444a-9da1-139f7a0cf7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:15.309929 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5f81f-ec7f-444a-9da1-139f7a0cf7c1 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:15.309929 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5f81f-ec7f-444a-9da1-139f7a0cf7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:15.310211 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5f81f-ec7f-444a-9da1-139f7a0cf7c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:15.311436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5f81f-ec7f-444a-9da1-139f7a0cf7c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:15.312370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5f81f-ec7f-444a-9da1-139f7a0cf7c1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:15.350021 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Jun 15 09:30:15 2022] POST /identity/v3/projects => generated 312 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:30:15.449772 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536f326-5640-4900-8e20-94c19751aa97 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:15.466245 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:15.493734 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5e30e-371a-4247-b204-aa356e48e7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:15.494422 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5e30e-371a-4247-b204-aa356e48e7fe None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:15.494740 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5e30e-371a-4247-b204-aa356e48e7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:15.495057 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5e30e-371a-4247-b204-aa356e48e7fe None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:15.496289 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5e30e-371a-4247-b204-aa356e48e7fe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:15.497659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5e30e-371a-4247-b204-aa356e48e7fe None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:15.533911 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Jun 15 09:30:15 2022] POST /identity/v3/projects => generated 301 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:30:17.031331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd6810-4b87-4e0c-bdab-83f43e25f964 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:17.031843 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd6810-4b87-4e0c-bdab-83f43e25f964 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:17.031923 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd6810-4b87-4e0c-bdab-83f43e25f964 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:17.033415 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 23/47] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:17.039114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bf401-b3e7-4a95-a8ae-e9f3c7311bfd None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:17.039546 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bf401-b3e7-4a95-a8ae-e9f3c7311bfd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:17.039680 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bf401-b3e7-4a95-a8ae-e9f3c7311bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:17.056520 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8c9bf401-b3e7-4a95-a8ae-e9f3c7311bfd None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:17.057725 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8c9bf401-b3e7-4a95-a8ae-e9f3c7311bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:17.127230 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 25/48] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:17.151066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd6810-4b87-4e0c-bdab-83f43e25f964 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:17.215060 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:17.258835 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd6810-4b87-4e0c-bdab-83f43e25f964 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:17.295094 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98568ad-3cfa-4b05-968d-43fcaeeedc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:17.295807 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98568ad-3cfa-4b05-968d-43fcaeeedc29 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:17.296097 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98568ad-3cfa-4b05-968d-43fcaeeedc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:17.296377 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98568ad-3cfa-4b05-968d-43fcaeeedc29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:17.307613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98568ad-3cfa-4b05-968d-43fcaeeedc29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f98568ad-3cfa-4b05-968d-43fcaeeedc29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:17.316389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:17.317244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:17.318143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:17.318143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:17.318143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:17.318143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:17.318143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:17.318143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:17.318143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:17.318143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:17.318143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:17.318143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:17.318143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:17.318143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:17.318143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 24/49] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:30:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:17.323460 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bf401-b3e7-4a95-a8ae-e9f3c7311bfd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:17.419574 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:17.428633 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bf401-b3e7-4a95-a8ae-e9f3c7311bfd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:17.463048 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e6fc0-a5fa-4de0-925d-94531efcfaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:17.463730 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e6fc0-a5fa-4de0-925d-94531efcfaff None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:17.464012 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e6fc0-a5fa-4de0-925d-94531efcfaff None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:17.464292 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e6fc0-a5fa-4de0-925d-94531efcfaff None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:17.465058 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e6fc0-a5fa-4de0-925d-94531efcfaff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:17.465369 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e6fc0-a5fa-4de0-925d-94531efcfaff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:17.466819 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e6fc0-a5fa-4de0-925d-94531efcfaff None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:17.476455 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 26/50] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:17.482376 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98568ad-3cfa-4b05-968d-43fcaeeedc29 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:17.547179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c01dc1-4c11-4f57-a9eb-aa008b2e5691 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:17.547416 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c01dc1-4c11-4f57-a9eb-aa008b2e5691 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:17.547709 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c01dc1-4c11-4f57-a9eb-aa008b2e5691 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:17.549067 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 27/51] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:30:17.553901 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975879a-4f50-475c-8532-fd684fc7e121 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:17.554192 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975879a-4f50-475c-8532-fd684fc7e121 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:17.554472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975879a-4f50-475c-8532-fd684fc7e121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:17.571688 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0975879a-4f50-475c-8532-fd684fc7e121 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:17.572919 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0975879a-4f50-475c-8532-fd684fc7e121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:17.589475 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98568ad-3cfa-4b05-968d-43fcaeeedc29 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:17.608362 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:17.626272 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37961b5-95a8-43e4-8eeb-6602ca7ca5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:17.627224 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37961b5-95a8-43e4-8eeb-6602ca7ca5be None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:17.627509 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37961b5-95a8-43e4-8eeb-6602ca7ca5be None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:17.627810 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37961b5-95a8-43e4-8eeb-6602ca7ca5be None admin] PATH_INFO: `/v3/users/99cee851d5f84c3782ff1a60b5667a3d` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:17.629612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37961b5-95a8-43e4-8eeb-6602ca7ca5be None admin] RBAC: Authorizing `identity:get_user(user_id=99cee851d5f84c3782ff1a60b5667a3d)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:17.631164 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37961b5-95a8-43e4-8eeb-6602ca7ca5be None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:17.632982 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 25/52] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:17 2022] GET /identity/v3/users/99cee851d5f84c3782ff1a60b5667a3d => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:17.638648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37961b5-95a8-43e4-8eeb-6602ca7ca5be None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:17.651944 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 28/53] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:30:17.674242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975879a-4f50-475c-8532-fd684fc7e121 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:17.742603 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37961b5-95a8-43e4-8eeb-6602ca7ca5be None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:17.760213 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:17.776681 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975879a-4f50-475c-8532-fd684fc7e121 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:17.778822 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85799c7e-5f13-4547-9813-5778a56a0d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:17.779631 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85799c7e-5f13-4547-9813-5778a56a0d07 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:17.779921 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85799c7e-5f13-4547-9813-5778a56a0d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:17.780204 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85799c7e-5f13-4547-9813-5778a56a0d07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:17.781401 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85799c7e-5f13-4547-9813-5778a56a0d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:17.782893 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85799c7e-5f13-4547-9813-5778a56a0d07 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:17.784524 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 26/54] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:30:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:17.790278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85799c7e-5f13-4547-9813-5778a56a0d07 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:17.813984 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb47b41-7a68-49fc-87bc-24dccd5d79e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:17.813984 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb47b41-7a68-49fc-87bc-24dccd5d79e2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:17.814230 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb47b41-7a68-49fc-87bc-24dccd5d79e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:17.814581 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb47b41-7a68-49fc-87bc-24dccd5d79e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:17.815841 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb47b41-7a68-49fc-87bc-24dccd5d79e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:17.817350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb47b41-7a68-49fc-87bc-24dccd5d79e2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:17.819525 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 29/55] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:30:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:17.825008 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb47b41-7a68-49fc-87bc-24dccd5d79e2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:17.847137 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:17.893475 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85799c7e-5f13-4547-9813-5778a56a0d07 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:17.929213 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb47b41-7a68-49fc-87bc-24dccd5d79e2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:17.929917 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8b90e-458e-4abc-b5f1-459482294f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:17.930610 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8b90e-458e-4abc-b5f1-459482294f35 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:17.930900 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8b90e-458e-4abc-b5f1-459482294f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:17.931177 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8b90e-458e-4abc-b5f1-459482294f35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:17.932017 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8b90e-458e-4abc-b5f1-459482294f35 None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.domain.id=default, user.id=99cee851d5f84c3782ff1a60b5667a3d) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:17.932336 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8b90e-458e-4abc-b5f1-459482294f35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:17.933793 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8b90e-458e-4abc-b5f1-459482294f35 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:17.943095 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 27/56] 10.222.0.45 () {56 vars in 1322 bytes} [Wed Jun 15 09:30:17 2022] GET /identity/v3/role_assignments?user.id=99cee851d5f84c3782ff1a60b5667a3d&scope.domain.id=default&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:17.967321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08341cfc-6d0f-40ce-b84d-3d7c02569dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:17.968038 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08341cfc-6d0f-40ce-b84d-3d7c02569dba None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:17.968324 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08341cfc-6d0f-40ce-b84d-3d7c02569dba None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:17.968602 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08341cfc-6d0f-40ce-b84d-3d7c02569dba None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:17.969331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08341cfc-6d0f-40ce-b84d-3d7c02569dba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:17.970852 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08341cfc-6d0f-40ce-b84d-3d7c02569dba None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:17.998170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 30/57] 10.222.0.45 () {60 vars in 1140 bytes} [Wed Jun 15 09:30:17 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 09:30:20.142138 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746da93-5e6f-4a38-a0e7-3ba9f4f0bebc None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:20.142678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746da93-5e6f-4a38-a0e7-3ba9f4f0bebc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:20.142793 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746da93-5e6f-4a38-a0e7-3ba9f4f0bebc None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:20.144595 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 28/58] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:20.150961 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c444a9-8ec9-4724-a6b7-38707b685154 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:20.151388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c444a9-8ec9-4724-a6b7-38707b685154 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:20.151543 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c444a9-8ec9-4724-a6b7-38707b685154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:20.163678 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:20.169356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-01c444a9-8ec9-4724-a6b7-38707b685154 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:20.170999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-01c444a9-8ec9-4724-a6b7-38707b685154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:20.236638 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 31/59] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:20.260460 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746da93-5e6f-4a38-a0e7-3ba9f4f0bebc None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:20.365278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746da93-5e6f-4a38-a0e7-3ba9f4f0bebc None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:20.382633 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:20.400469 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f062bf-4a35-4b14-b6d4-d3f460887cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:20.401200 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f062bf-4a35-4b14-b6d4-d3f460887cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:20.401492 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f062bf-4a35-4b14-b6d4-d3f460887cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:20.401778 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f062bf-4a35-4b14-b6d4-d3f460887cf0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:20.403042 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f062bf-4a35-4b14-b6d4-d3f460887cf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:20.404533 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f062bf-4a35-4b14-b6d4-d3f460887cf0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:20.406333 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 29/60] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:30:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:20.411687 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c444a9-8ec9-4724-a6b7-38707b685154 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:20.508690 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c444a9-8ec9-4724-a6b7-38707b685154 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:20.542970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba741e0-512f-4148-8016-4b12aad17b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:20.543649 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba741e0-512f-4148-8016-4b12aad17b28 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:20.543938 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba741e0-512f-4148-8016-4b12aad17b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:20.544216 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba741e0-512f-4148-8016-4b12aad17b28 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:20.545222 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba741e0-512f-4148-8016-4b12aad17b28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:20.546366 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba741e0-512f-4148-8016-4b12aad17b28 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:20.557040 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:20.573108 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 32/61] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:30:20 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:30:23.812028 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1daba-03f8-41a6-8957-d52f382bceaa None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:23.812534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1daba-03f8-41a6-8957-d52f382bceaa None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:23.812534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1daba-03f8-41a6-8957-d52f382bceaa None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:23.813937 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 30/62] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:23.820437 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5530d-8e4a-4417-9a0f-69a1cb562edd None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:23.820927 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5530d-8e4a-4417-9a0f-69a1cb562edd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:23.821021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5530d-8e4a-4417-9a0f-69a1cb562edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:23.852467 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-79d5530d-8e4a-4417-9a0f-69a1cb562edd None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:23.853697 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-79d5530d-8e4a-4417-9a0f-69a1cb562edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:23.938089 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633316e-af66-4bb8-b559-4fb863e89949 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:23.938401 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633316e-af66-4bb8-b559-4fb863e89949 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:23.938688 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633316e-af66-4bb8-b559-4fb863e89949 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:23.940059 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:23.954279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e8c94-d1ad-4c8a-aa64-bc1017d46725 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:23.954279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e8c94-d1ad-4c8a-aa64-bc1017d46725 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:23.954279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e8c94-d1ad-4c8a-aa64-bc1017d46725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:23.975385 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 33/64] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:23.976346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-024e8c94-d1ad-4c8a-aa64-bc1017d46725 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:23.977553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-024e8c94-d1ad-4c8a-aa64-bc1017d46725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:24.051948 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5530d-8e4a-4417-9a0f-69a1cb562edd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:24.080039 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 32/65] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:30:24.120882 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e8c94-d1ad-4c8a-aa64-bc1017d46725 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:24.207094 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5530d-8e4a-4417-9a0f-69a1cb562edd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:24.232477 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:24.248277 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c58e25-2bcf-41ce-ab49-c16e6260ea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:24.249377 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c58e25-2bcf-41ce-ab49-c16e6260ea79 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:24.249816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c58e25-2bcf-41ce-ab49-c16e6260ea79 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:24.250284 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c58e25-2bcf-41ce-ab49-c16e6260ea79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:24.258142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e8c94-d1ad-4c8a-aa64-bc1017d46725 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:24.267516 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c58e25-2bcf-41ce-ab49-c16e6260ea79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:24.276457 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-61c58e25-2bcf-41ce-ab49-c16e6260ea79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:24.277396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:24.278329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:24.279355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:24.279355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:24.279355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:24.279355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:24.279355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:24.279355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:24.279355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:24.279355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:24.279355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:24.279355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:24.279355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:24.279355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:30:24.279355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 34/66] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:30:24.280551 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b8dbb-1399-4c2b-9ebb-c2f6c3987424 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:24.280721 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b8dbb-1399-4c2b-9ebb-c2f6c3987424 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:24.282345 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b8dbb-1399-4c2b-9ebb-c2f6c3987424 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:24.287445 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 35/67] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:24.288244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b8dbb-1399-4c2b-9ebb-c2f6c3987424 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:24.301593 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9433fd-ac77-4082-b6bb-c686beedfffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:24.302763 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9433fd-ac77-4082-b6bb-c686beedfffc None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:24.303244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9433fd-ac77-4082-b6bb-c686beedfffc None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:24.303736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9433fd-ac77-4082-b6bb-c686beedfffc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:24.316198 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9433fd-ac77-4082-b6bb-c686beedfffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-fb9433fd-ac77-4082-b6bb-c686beedfffc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:24.324297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:24.325142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:24.325986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:24.325986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:24.325986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:24.325986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:24.325986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:24.325986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:24.325986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:24.325986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:24.325986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:24.325986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:24.325986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:24.325986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:24.328809 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 33/68] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:30:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:24.330543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99720f3-2e7e-4e74-9b46-e94163f4ec8b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:24.331084 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99720f3-2e7e-4e74-9b46-e94163f4ec8b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:24.331557 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99720f3-2e7e-4e74-9b46-e94163f4ec8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:24.349269 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c99720f3-2e7e-4e74-9b46-e94163f4ec8b None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:24.350887 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c99720f3-2e7e-4e74-9b46-e94163f4ec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:24.418318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b8dbb-1399-4c2b-9ebb-c2f6c3987424 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:24.433233 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 34/69] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:24.434547 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99720f3-2e7e-4e74-9b46-e94163f4ec8b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:24.469874 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390992e8-c3ba-4c39-b4c0-b185a10a0363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:24.470593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390992e8-c3ba-4c39-b4c0-b185a10a0363 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:24.470891 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390992e8-c3ba-4c39-b4c0-b185a10a0363 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:24.472408 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390992e8-c3ba-4c39-b4c0-b185a10a0363 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:24.472515 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390992e8-c3ba-4c39-b4c0-b185a10a0363 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:24.472778 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390992e8-c3ba-4c39-b4c0-b185a10a0363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:24.474188 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390992e8-c3ba-4c39-b4c0-b185a10a0363 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:24.483245 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 36/70] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:30:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:24.484557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81edd8-1ace-4bcd-aebb-84addcb22e62 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:24.484857 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81edd8-1ace-4bcd-aebb-84addcb22e62 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:24.485145 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81edd8-1ace-4bcd-aebb-84addcb22e62 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:24.490682 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 37/71] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:24.490682 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81edd8-1ace-4bcd-aebb-84addcb22e62 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:24.543832 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:24.557687 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99720f3-2e7e-4e74-9b46-e94163f4ec8b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:24.565462 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:24.598834 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea667ab-2892-44bc-8a32-34a52ef79a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:24.599565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea667ab-2892-44bc-8a32-34a52ef79a0b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:24.599859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea667ab-2892-44bc-8a32-34a52ef79a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:24.600139 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea667ab-2892-44bc-8a32-34a52ef79a0b None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:24.601092 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea667ab-2892-44bc-8a32-34a52ef79a0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:24.601407 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea667ab-2892-44bc-8a32-34a52ef79a0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:24.602865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea667ab-2892-44bc-8a32-34a52ef79a0b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:24.607719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81edd8-1ace-4bcd-aebb-84addcb22e62 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:24.619900 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 35/72] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:24.621016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea667ab-2892-44bc-8a32-34a52ef79a0b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:24.651487 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa48c62-7bee-4138-8a3f-8474c821d5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:24.652318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa48c62-7bee-4138-8a3f-8474c821d5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:24.652609 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa48c62-7bee-4138-8a3f-8474c821d5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:24.652895 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa48c62-7bee-4138-8a3f-8474c821d5d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:24.664052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa48c62-7bee-4138-8a3f-8474c821d5d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5aa48c62-7bee-4138-8a3f-8474c821d5d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:24.672185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:24.673031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:24.673813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:24.673813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:24.673813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:24.673813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:24.673813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:24.673813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:24.673813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:24.673813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:24.673813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:24.673813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:24.673813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:30:24.673813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:30:24.673813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 38/73] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:30:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:24.674762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5565756-7112-4058-be82-5a5688c14417 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:24.675311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5565756-7112-4058-be82-5a5688c14417 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:24.675601 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5565756-7112-4058-be82-5a5688c14417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:24.692222 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f5565756-7112-4058-be82-5a5688c14417 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:24.693483 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f5565756-7112-4058-be82-5a5688c14417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:24.731764 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea667ab-2892-44bc-8a32-34a52ef79a0b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:24.768038 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 39/74] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:24.769434 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5565756-7112-4058-be82-5a5688c14417 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:24.769672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4705ab-01a8-4669-bf88-3689e7ba1da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:24.770587 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4705ab-01a8-4669-bf88-3689e7ba1da4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:24.770876 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4705ab-01a8-4669-bf88-3689e7ba1da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:24.771155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4705ab-01a8-4669-bf88-3689e7ba1da4 None admin] PATH_INFO: `/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:24.787589 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4705ab-01a8-4669-bf88-3689e7ba1da4 None admin] RBAC: Authorizing `identity:get_user(user_id=bd892ec4fbfa4f31bcd7d81f7be2ea09)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:24.789673 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4705ab-01a8-4669-bf88-3689e7ba1da4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:24.791488 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 36/75] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:24 2022] GET /identity/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:24.795834 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792472c-7bf3-4bc0-9303-bf9b97983907 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:24.796130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792472c-7bf3-4bc0-9303-bf9b97983907 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:24.796415 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792472c-7bf3-4bc0-9303-bf9b97983907 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:24.797796 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 37/76] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:24.798397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792472c-7bf3-4bc0-9303-bf9b97983907 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:24.809251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:24.826646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:24.890548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5565756-7112-4058-be82-5a5688c14417 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:24.907425 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792472c-7bf3-4bc0-9303-bf9b97983907 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:24.925173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61254f30-cccb-4877-b92f-7a1552ada0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:24.926062 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254f30-cccb-4877-b92f-7a1552ada0ed None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:24.926346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254f30-cccb-4877-b92f-7a1552ada0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:24.926656 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61254f30-cccb-4877-b92f-7a1552ada0ed None admin] PATH_INFO: `/v3/users/99cee851d5f84c3782ff1a60b5667a3d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:24.928048 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61254f30-cccb-4877-b92f-7a1552ada0ed None admin] RBAC: Authorizing `identity:get_user(user_id=99cee851d5f84c3782ff1a60b5667a3d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:24.929500 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61254f30-cccb-4877-b92f-7a1552ada0ed None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:24.931199 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 40/77] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:24 2022] GET /identity/v3/users/99cee851d5f84c3782ff1a60b5667a3d => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:24.931979 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61254f30-cccb-4877-b92f-7a1552ada0ed None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:24.943432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca942ecc-e60d-4401-88f4-18ec008ceb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:24.944123 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca942ecc-e60d-4401-88f4-18ec008ceb03 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:24.944416 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca942ecc-e60d-4401-88f4-18ec008ceb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:24.944700 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca942ecc-e60d-4401-88f4-18ec008ceb03 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:24.945473 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca942ecc-e60d-4401-88f4-18ec008ceb03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:24.945789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca942ecc-e60d-4401-88f4-18ec008ceb03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:24.947231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca942ecc-e60d-4401-88f4-18ec008ceb03 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:24.957301 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 38/78] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:30:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:24.958070 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca942ecc-e60d-4401-88f4-18ec008ceb03 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:25.038263 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61254f30-cccb-4877-b92f-7a1552ada0ed None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:25.039795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:25.051818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:25.070276 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca942ecc-e60d-4401-88f4-18ec008ceb03 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:25.079277 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f0ab8-7292-4783-82c6-434a775d84a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:25.080080 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f0ab8-7292-4783-82c6-434a775d84a0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:25.080428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f0ab8-7292-4783-82c6-434a775d84a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:25.080651 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f0ab8-7292-4783-82c6-434a775d84a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:25.082407 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f0ab8-7292-4783-82c6-434a775d84a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:25.083968 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f0ab8-7292-4783-82c6-434a775d84a0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:25.085667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 41/79] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:30:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:25.086908 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1921ee4-2f1e-43eb-a08a-0d1077c150b1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:25.087191 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1921ee4-2f1e-43eb-a08a-0d1077c150b1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:25.087469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1921ee4-2f1e-43eb-a08a-0d1077c150b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:25.104464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c1921ee4-2f1e-43eb-a08a-0d1077c150b1 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:25.105698 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c1921ee4-2f1e-43eb-a08a-0d1077c150b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:25.111767 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d6417-5e5d-4124-a879-38ac7361ffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:25.112434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d6417-5e5d-4124-a879-38ac7361ffd6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:25.112722 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d6417-5e5d-4124-a879-38ac7361ffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:25.113003 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d6417-5e5d-4124-a879-38ac7361ffd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:25.175197 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 42/80] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:25.175961 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1921ee4-2f1e-43eb-a08a-0d1077c150b1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:25.186752 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d6417-5e5d-4124-a879-38ac7361ffd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:25.188570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d6417-5e5d-4124-a879-38ac7361ffd6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:25.278724 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:25.281383 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:25.282990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1921ee4-2f1e-43eb-a08a-0d1077c150b1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:25.298139 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 39/81] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:30:25.300505 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d6417-5e5d-4124-a879-38ac7361ffd6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:25.322996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89693500-132d-4cd8-bed1-3fed1c574207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:25.323660 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89693500-132d-4cd8-bed1-3fed1c574207 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:25.324285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89693500-132d-4cd8-bed1-3fed1c574207 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:25.324285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89693500-132d-4cd8-bed1-3fed1c574207 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:25.397236 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89693500-132d-4cd8-bed1-3fed1c574207 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:25.398761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89693500-132d-4cd8-bed1-3fed1c574207 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:25.406827 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d6417-5e5d-4124-a879-38ac7361ffd6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:25.441068 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906fc2e-4b87-4889-a4e3-32b7e08d0153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:25.441868 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906fc2e-4b87-4889-a4e3-32b7e08d0153 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:25.442151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906fc2e-4b87-4889-a4e3-32b7e08d0153 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:25.442426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906fc2e-4b87-4889-a4e3-32b7e08d0153 None admin] PATH_INFO: `/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:25.443662 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906fc2e-4b87-4889-a4e3-32b7e08d0153 None admin] RBAC: Authorizing `identity:get_user(user_id=bd892ec4fbfa4f31bcd7d81f7be2ea09)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:25.445123 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906fc2e-4b87-4889-a4e3-32b7e08d0153 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:25.447012 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 40/82] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:25 2022] GET /identity/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:25.447694 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906fc2e-4b87-4889-a4e3-32b7e08d0153 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:25.501982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:25.507270 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:25.510873 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 43/83] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:30:25.511689 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89693500-132d-4cd8-bed1-3fed1c574207 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:25.555113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906fc2e-4b87-4889-a4e3-32b7e08d0153 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:25.590405 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3c96e-d13e-4638-8280-c771b4e80308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:25.591119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3c96e-d13e-4638-8280-c771b4e80308 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:25.591407 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3c96e-d13e-4638-8280-c771b4e80308 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:25.591686 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3c96e-d13e-4638-8280-c771b4e80308 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:25.592416 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3c96e-d13e-4638-8280-c771b4e80308 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:25.594128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3c96e-d13e-4638-8280-c771b4e80308 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:25.616308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89693500-132d-4cd8-bed1-3fed1c574207 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:25.620596 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 41/84] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:30:25 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:30:25.621446 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3c96e-d13e-4638-8280-c771b4e80308 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:25.662724 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfbb3f-db78-48cd-8f16-644562328316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:25.663562 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfbb3f-db78-48cd-8f16-644562328316 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:25.663852 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfbb3f-db78-48cd-8f16-644562328316 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:25.664137 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfbb3f-db78-48cd-8f16-644562328316 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:25.678403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfbb3f-db78-48cd-8f16-644562328316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d5cfbb3f-db78-48cd-8f16-644562328316 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:25.687071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:25.688782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:25.690308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:25.690308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:25.690308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:25.690308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:25.690308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:25.690308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:25.690308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:25.690308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:25.690308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:25.690308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:25.690308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:25.690308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:30:25.690308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 44/85] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:25.690308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfbb3f-db78-48cd-8f16-644562328316 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:25.743269 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3c96e-d13e-4638-8280-c771b4e80308 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:25.758242 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:25.766788 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:25.784833 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90444fb-c6a0-45b5-bd4b-cb36a3e285f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:25.785908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90444fb-c6a0-45b5-bd4b-cb36a3e285f8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:25.786273 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90444fb-c6a0-45b5-bd4b-cb36a3e285f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:25.786692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90444fb-c6a0-45b5-bd4b-cb36a3e285f8 None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:25.788236 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90444fb-c6a0-45b5-bd4b-cb36a3e285f8 None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:25.789863 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90444fb-c6a0-45b5-bd4b-cb36a3e285f8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:25.791818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 42/86] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:25 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:25.792667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90444fb-c6a0-45b5-bd4b-cb36a3e285f8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:25.827626 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfbb3f-db78-48cd-8f16-644562328316 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:25.875135 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bd2f4-5876-4487-a4c5-aae5e248b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:25.876128 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bd2f4-5876-4487-a4c5-aae5e248b060 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:25.876423 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bd2f4-5876-4487-a4c5-aae5e248b060 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:25.876709 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bd2f4-5876-4487-a4c5-aae5e248b060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:25.940470 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90444fb-c6a0-45b5-bd4b-cb36a3e285f8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:25.992065 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bd2f4-5876-4487-a4c5-aae5e248b060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:25.993657 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bd2f4-5876-4487-a4c5-aae5e248b060 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:25.999621 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d48af0-8442-48b2-b930-2c0c3a2e4d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:26.000151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d48af0-8442-48b2-b930-2c0c3a2e4d71 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:26.000437 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d48af0-8442-48b2-b930-2c0c3a2e4d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:26.000804 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d48af0-8442-48b2-b930-2c0c3a2e4d71 None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:26.001989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d48af0-8442-48b2-b930-2c0c3a2e4d71 None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:26.004118 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d48af0-8442-48b2-b930-2c0c3a2e4d71 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:26.006844 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 43/87] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:25 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:26.007556 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d48af0-8442-48b2-b930-2c0c3a2e4d71 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:26.066583 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:26.080792 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:26.114383 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 45/88] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:30:26.115140 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bd2f4-5876-4487-a4c5-aae5e248b060 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:26.145788 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d48af0-8442-48b2-b930-2c0c3a2e4d71 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:26.198533 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ba84e-ca60-41b2-a44a-2789114179a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:26.202523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ba84e-ca60-41b2-a44a-2789114179a4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:26.202523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ba84e-ca60-41b2-a44a-2789114179a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:26.202523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ba84e-ca60-41b2-a44a-2789114179a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:26.202523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ba84e-ca60-41b2-a44a-2789114179a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:26.202523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ba84e-ca60-41b2-a44a-2789114179a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:26.205136 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ba84e-ca60-41b2-a44a-2789114179a4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:26.216161 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 44/89] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:30:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:26.217053 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ba84e-ca60-41b2-a44a-2789114179a4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:26.250606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bd2f4-5876-4487-a4c5-aae5e248b060 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:26.287745 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed385f6-9a31-44cd-8430-7893aafdee7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:26.290525 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed385f6-9a31-44cd-8430-7893aafdee7a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:26.290525 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed385f6-9a31-44cd-8430-7893aafdee7a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:26.290525 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed385f6-9a31-44cd-8430-7893aafdee7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:26.290525 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed385f6-9a31-44cd-8430-7893aafdee7a None admin] RBAC: Adding query filter params (role.id=edcc1e17fab74f2d93941e3c37b66546, scope.project.id=50c4a61b8f494e029afaea135bfd4777, user.id=bd892ec4fbfa4f31bcd7d81f7be2ea09) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:26.290525 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed385f6-9a31-44cd-8430-7893aafdee7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:26.294522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed385f6-9a31-44cd-8430-7893aafdee7a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:26.297646 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 46/90] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:26 2022] GET /identity/v3/role_assignments?user.id=bd892ec4fbfa4f31bcd7d81f7be2ea09&scope.project.id=50c4a61b8f494e029afaea135bfd4777&role.id=edcc1e17fab74f2d93941e3c37b66546 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:26.298476 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed385f6-9a31-44cd-8430-7893aafdee7a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:26.348414 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:26.358592 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ba84e-ca60-41b2-a44a-2789114179a4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:26.371596 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:26.401661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8153c31-dfe6-4407-b1e3-e13387f16a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:26.402349 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8153c31-dfe6-4407-b1e3-e13387f16a06 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:26.402666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8153c31-dfe6-4407-b1e3-e13387f16a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:26.402955 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8153c31-dfe6-4407-b1e3-e13387f16a06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:26.403820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8153c31-dfe6-4407-b1e3-e13387f16a06 None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=50c4a61b8f494e029afaea135bfd4777, user.id=99cee851d5f84c3782ff1a60b5667a3d) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:26.404141 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8153c31-dfe6-4407-b1e3-e13387f16a06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:26.405654 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8153c31-dfe6-4407-b1e3-e13387f16a06 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:26.412554 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 45/91] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:26 2022] GET /identity/v3/role_assignments?user.id=99cee851d5f84c3782ff1a60b5667a3d&scope.project.id=50c4a61b8f494e029afaea135bfd4777&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:26.413439 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8153c31-dfe6-4407-b1e3-e13387f16a06 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:26.536680 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed385f6-9a31-44cd-8430-7893aafdee7a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:26.605625 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8153c31-dfe6-4407-b1e3-e13387f16a06 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:26.615167 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e142f4d-3bb1-495d-964c-a85eb9007dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:26.616057 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e142f4d-3bb1-495d-964c-a85eb9007dcd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:26.616346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e142f4d-3bb1-495d-964c-a85eb9007dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:26.616630 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e142f4d-3bb1-495d-964c-a85eb9007dcd None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:26.624950 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e142f4d-3bb1-495d-964c-a85eb9007dcd None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:26.626451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e142f4d-3bb1-495d-964c-a85eb9007dcd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:26.629051 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 47/92] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:26 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:26.651301 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e142f4d-3bb1-495d-964c-a85eb9007dcd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:26.686864 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273eea7-36c2-4629-a40b-be64f30fc8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:26.687776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273eea7-36c2-4629-a40b-be64f30fc8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:26.688072 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273eea7-36c2-4629-a40b-be64f30fc8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:26.688356 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273eea7-36c2-4629-a40b-be64f30fc8e7 None admin] PATH_INFO: `/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:26.690839 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273eea7-36c2-4629-a40b-be64f30fc8e7 None admin] RBAC: Authorizing `identity:get_user(user_id=bd892ec4fbfa4f31bcd7d81f7be2ea09)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:26.691911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273eea7-36c2-4629-a40b-be64f30fc8e7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:26.695365 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 46/93] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:26 2022] GET /identity/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:26.700138 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273eea7-36c2-4629-a40b-be64f30fc8e7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:26.776608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:26.858943 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:26.876842 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e142f4d-3bb1-495d-964c-a85eb9007dcd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:26.948185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273eea7-36c2-4629-a40b-be64f30fc8e7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:27.010037 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af844aa6-ab61-4483-8f4a-f495df08bbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:27.010804 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af844aa6-ab61-4483-8f4a-f495df08bbdc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:27.011099 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af844aa6-ab61-4483-8f4a-f495df08bbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:27.011385 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af844aa6-ab61-4483-8f4a-f495df08bbdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:27.012242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af844aa6-ab61-4483-8f4a-f495df08bbdc None admin] RBAC: Adding query filter params (role.id=f0b3744c39ca4eb7b78ef642c0175a0a, scope.project.id=50c4a61b8f494e029afaea135bfd4777, user.id=bd892ec4fbfa4f31bcd7d81f7be2ea09) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:27.012566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af844aa6-ab61-4483-8f4a-f495df08bbdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:27.014034 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af844aa6-ab61-4483-8f4a-f495df08bbdc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:27.023649 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 48/94] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:26 2022] GET /identity/v3/role_assignments?user.id=bd892ec4fbfa4f31bcd7d81f7be2ea09&scope.project.id=50c4a61b8f494e029afaea135bfd4777&role.id=f0b3744c39ca4eb7b78ef642c0175a0a => generated 259 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:27.059359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5821653-6118-4c64-8020-6ee1fb3d0bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:27.060064 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5821653-6118-4c64-8020-6ee1fb3d0bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:27.060363 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5821653-6118-4c64-8020-6ee1fb3d0bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:27.060653 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5821653-6118-4c64-8020-6ee1fb3d0bc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:27.190362 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5821653-6118-4c64-8020-6ee1fb3d0bc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:27.191833 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5821653-6118-4c64-8020-6ee1fb3d0bc9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:27.257052 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:27.363624 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 47/95] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:30:27.370318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af844aa6-ab61-4483-8f4a-f495df08bbdc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:27.583628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af844aa6-ab61-4483-8f4a-f495df08bbdc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:27.650306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce422129-202a-4b3e-b85e-ada459f59635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:27.651240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce422129-202a-4b3e-b85e-ada459f59635 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:27.651625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce422129-202a-4b3e-b85e-ada459f59635 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:27.651915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce422129-202a-4b3e-b85e-ada459f59635 None admin] PATH_INFO: `/v3/projects/00474714affc48678578060800edd2ae` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:27.659367 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce422129-202a-4b3e-b85e-ada459f59635 None admin] RBAC: Authorizing `identity:get_project(project_id=00474714affc48678578060800edd2ae)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:27.660859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce422129-202a-4b3e-b85e-ada459f59635 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:27.662664 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 49/96] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:27 2022] GET /identity/v3/projects/00474714affc48678578060800edd2ae => generated 312 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:27.668609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5821653-6118-4c64-8020-6ee1fb3d0bc9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:27.805004 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5821653-6118-4c64-8020-6ee1fb3d0bc9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:27.859242 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77165d-b3ff-4c29-9811-3d25abc5fb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:27.860202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77165d-b3ff-4c29-9811-3d25abc5fb7d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:27.860651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77165d-b3ff-4c29-9811-3d25abc5fb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:27.861096 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77165d-b3ff-4c29-9811-3d25abc5fb7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:27.862663 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77165d-b3ff-4c29-9811-3d25abc5fb7d None admin] RBAC: Adding query filter params (role.id=edcc1e17fab74f2d93941e3c37b66546, scope.project.id=00474714affc48678578060800edd2ae, user.id=bd892ec4fbfa4f31bcd7d81f7be2ea09) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:27.863147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77165d-b3ff-4c29-9811-3d25abc5fb7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:27.864790 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77165d-b3ff-4c29-9811-3d25abc5fb7d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:27.871530 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 48/97] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:27 2022] GET /identity/v3/role_assignments?user.id=bd892ec4fbfa4f31bcd7d81f7be2ea09&scope.project.id=00474714affc48678578060800edd2ae&role.id=edcc1e17fab74f2d93941e3c37b66546 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:28.555333 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2448881-2b83-4ae3-be7f-a9046c1ed6f6 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:28.555333 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2448881-2b83-4ae3-be7f-a9046c1ed6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:28.555333 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2448881-2b83-4ae3-be7f-a9046c1ed6f6 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:28.555333 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 50/98] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:28.560859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc4b1-c997-4d6f-9a74-2fb1a29fab0a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:28.561623 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc4b1-c997-4d6f-9a74-2fb1a29fab0a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:28.562054 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197dc4b1-c997-4d6f-9a74-2fb1a29fab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:28.579483 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:28.595700 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-197dc4b1-c997-4d6f-9a74-2fb1a29fab0a None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:28.597799 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-197dc4b1-c997-4d6f-9a74-2fb1a29fab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:28.713197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 49/99] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:28.756620 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2448881-2b83-4ae3-be7f-a9046c1ed6f6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:28.807098 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:28.853118 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9731717-a6e0-4a89-9c87-ba4ff52a39dd None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:28.853413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9731717-a6e0-4a89-9c87-ba4ff52a39dd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:28.853866 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9731717-a6e0-4a89-9c87-ba4ff52a39dd None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:28.855434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 50/100] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:28.864049 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd519a3-43e8-4e09-a527-eeed911fd2f7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:28.864570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd519a3-43e8-4e09-a527-eeed911fd2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:28.865030 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd519a3-43e8-4e09-a527-eeed911fd2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:28.908342 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-3fd519a3-43e8-4e09-a527-eeed911fd2f7 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:28.915380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3fd519a3-43e8-4e09-a527-eeed911fd2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:29.017655 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2448881-2b83-4ae3-be7f-a9046c1ed6f6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:29.184031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 51/101] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:29.238508 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc2ffc-a4f8-4635-b503-934ae343d05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:29.238749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd519a3-43e8-4e09-a527-eeed911fd2f7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:29.238851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc2ffc-a4f8-4635-b503-934ae343d05c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:29.238851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc2ffc-a4f8-4635-b503-934ae343d05c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:29.238851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc2ffc-a4f8-4635-b503-934ae343d05c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:29.298557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc2ffc-a4f8-4635-b503-934ae343d05c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-58bc2ffc-a4f8-4635-b503-934ae343d05c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:29.303795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:29.304737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:29.305521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:29.305521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:29.305521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:29.305521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:29.305521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:29.305521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:29.305521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:29.305521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:29.305521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:29.305521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:29.305521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:30:29.305521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:30:29.305521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 51/102] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 549 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:29.319611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc2ffc-a4f8-4635-b503-934ae343d05c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:29.473432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:29.642534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd519a3-43e8-4e09-a527-eeed911fd2f7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:29.655111 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:29.718812 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc2ffc-a4f8-4635-b503-934ae343d05c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:29.777206 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c562ce5-95e6-43ff-b596-1c4e0196333f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:29.778756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c562ce5-95e6-43ff-b596-1c4e0196333f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:29.779282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c562ce5-95e6-43ff-b596-1c4e0196333f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:29.779803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c562ce5-95e6-43ff-b596-1c4e0196333f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:29.784801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c562ce5-95e6-43ff-b596-1c4e0196333f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:29.787712 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c562ce5-95e6-43ff-b596-1c4e0196333f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:29.791183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 52/103] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:30:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 556 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:29.793304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b821d-4ea0-4479-a171-b1ab4afd2c3e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:29.805876 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b821d-4ea0-4479-a171-b1ab4afd2c3e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:29.805876 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b821d-4ea0-4479-a171-b1ab4afd2c3e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:29.805876 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 53/104] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:29 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:29.805876 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b821d-4ea0-4479-a171-b1ab4afd2c3e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:29.835309 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c680d2-2721-40d3-82e0-36355df352c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:29.836604 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c680d2-2721-40d3-82e0-36355df352c2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:29.837671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c680d2-2721-40d3-82e0-36355df352c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:29.838338 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c680d2-2721-40d3-82e0-36355df352c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:29.840660 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c680d2-2721-40d3-82e0-36355df352c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:29.841187 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c680d2-2721-40d3-82e0-36355df352c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:29.843641 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c680d2-2721-40d3-82e0-36355df352c2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:29.866163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 52/105] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:30:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 547 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:29.868689 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e62c1-ce00-4d61-a98d-096861d48411 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:29.869873 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e62c1-ce00-4d61-a98d-096861d48411 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:29.870575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e62c1-ce00-4d61-a98d-096861d48411 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:29.873800 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 53/106] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:29.876683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0276635-12e9-4276-ba04-5ca01a6edea5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:29.877395 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0276635-12e9-4276-ba04-5ca01a6edea5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:29.879896 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0276635-12e9-4276-ba04-5ca01a6edea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:29.915901 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e0276635-12e9-4276-ba04-5ca01a6edea5 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:29.917508 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e0276635-12e9-4276-ba04-5ca01a6edea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:29.985289 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b821d-4ea0-4479-a171-b1ab4afd2c3e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:30.055425 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 54/107] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:30.056250 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0276635-12e9-4276-ba04-5ca01a6edea5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:30.062872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30882f46-0fa9-4939-a7a0-099869aad5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:30.063561 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30882f46-0fa9-4939-a7a0-099869aad5f8 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:30.063858 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30882f46-0fa9-4939-a7a0-099869aad5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:30.064147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30882f46-0fa9-4939-a7a0-099869aad5f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:30.065095 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30882f46-0fa9-4939-a7a0-099869aad5f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:30.066623 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30882f46-0fa9-4939-a7a0-099869aad5f8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:30.077765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:30.113971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 54/108] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Jun 15 09:30:29 2022] POST /identity/v3/projects => generated 302 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:30:30.116672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91606bae-cc9f-42ab-8ac7-a7ce5947f40e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:30.116989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91606bae-cc9f-42ab-8ac7-a7ce5947f40e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:30.117432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91606bae-cc9f-42ab-8ac7-a7ce5947f40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:30.152549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-91606bae-cc9f-42ab-8ac7-a7ce5947f40e None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:30.154245 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-91606bae-cc9f-42ab-8ac7-a7ce5947f40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:30.209767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:30.269464 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 55/109] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:30.271280 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb394e9-1b06-49b9-8ecd-f2bd032f76bb None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:30.271859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb394e9-1b06-49b9-8ecd-f2bd032f76bb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:30.272352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb394e9-1b06-49b9-8ecd-f2bd032f76bb None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:30.274232 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 56/110] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:30.275332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb394e9-1b06-49b9-8ecd-f2bd032f76bb None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:30.315719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0276635-12e9-4276-ba04-5ca01a6edea5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:30.368302 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7f677-ccaf-46ba-a169-e8d1d62478ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:30.369236 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7f677-ccaf-46ba-a169-e8d1d62478ff None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:30.369519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7f677-ccaf-46ba-a169-e8d1d62478ff None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:30.369805 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7f677-ccaf-46ba-a169-e8d1d62478ff None admin] PATH_INFO: `/v3/users/b2d8a96f1c6d468dbd3633d2c68d6bfa` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:30.390192 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7f677-ccaf-46ba-a169-e8d1d62478ff None admin] RBAC: Authorizing `identity:get_user(user_id=b2d8a96f1c6d468dbd3633d2c68d6bfa)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:30.391929 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7f677-ccaf-46ba-a169-e8d1d62478ff None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:30.395570 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 55/111] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:30 2022] GET /identity/v3/users/b2d8a96f1c6d468dbd3633d2c68d6bfa => generated 289 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:30.396264 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f3173-0450-4225-9f61-0011d7652acf None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:30.396567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f3173-0450-4225-9f61-0011d7652acf None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:30.396856 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f3173-0450-4225-9f61-0011d7652acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:30.421859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb394e9-1b06-49b9-8ecd-f2bd032f76bb None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:30.428895 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-559f3173-0450-4225-9f61-0011d7652acf None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:30.430125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-559f3173-0450-4225-9f61-0011d7652acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:30.449451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:30.480266 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f69cc-5899-4a73-a3ac-541e0d201c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:30.481534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f69cc-5899-4a73-a3ac-541e0d201c5f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:30.481882 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f69cc-5899-4a73-a3ac-541e0d201c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:30.482173 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f69cc-5899-4a73-a3ac-541e0d201c5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:30.507210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f69cc-5899-4a73-a3ac-541e0d201c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-c94f69cc-5899-4a73-a3ac-541e0d201c5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:30.523268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:30.524527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:30.525279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:30.525279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:30.525279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:30.525279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:30.525279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:30.525279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:30.525279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:30.525279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:30.525279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:30.525279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:30.525279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:30.525279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:30.525279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 57/112] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:30.525923 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f69cc-5899-4a73-a3ac-541e0d201c5f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:30.542534 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 56/113] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:30.542534 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f3173-0450-4225-9f61-0011d7652acf None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:30.737544 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:30.776737 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f69cc-5899-4a73-a3ac-541e0d201c5f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:30.793002 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f3173-0450-4225-9f61-0011d7652acf None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:30.839285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3951e29-7dab-4d05-8742-6a7e42f3f6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:30.840209 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3951e29-7dab-4d05-8742-6a7e42f3f6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:30.840717 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3951e29-7dab-4d05-8742-6a7e42f3f6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:30.841396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3951e29-7dab-4d05-8742-6a7e42f3f6c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:30.844194 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d38ae6-e922-4789-94e8-bfd195feeed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:30.845283 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d38ae6-e922-4789-94e8-bfd195feeed5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:30.845777 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d38ae6-e922-4789-94e8-bfd195feeed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:30.846751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d38ae6-e922-4789-94e8-bfd195feeed5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:30.863483 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d38ae6-e922-4789-94e8-bfd195feeed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-48d38ae6-e922-4789-94e8-bfd195feeed5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:30.879523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:30.880450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:30.881191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:30.881191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:30.881191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:30.881191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:30.881191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:30.881191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:30.881191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:30.881191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:30.881191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:30.881191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:30.881191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:30.881191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:30.884820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 58/114] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:30:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:30.886437 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d38ae6-e922-4789-94e8-bfd195feeed5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:30.948333 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:30.951229 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3951e29-7dab-4d05-8742-6a7e42f3f6c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:30.953478 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3951e29-7dab-4d05-8742-6a7e42f3f6c6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:31.034380 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:31.063149 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d38ae6-e922-4789-94e8-bfd195feeed5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:31.088847 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 57/115] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:30:31.090578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3951e29-7dab-4d05-8742-6a7e42f3f6c6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:31.123004 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fb2c2-205f-46a0-aa3a-c0f179f2ac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:31.123719 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fb2c2-205f-46a0-aa3a-c0f179f2ac23 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:31.124013 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fb2c2-205f-46a0-aa3a-c0f179f2ac23 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:31.124298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fb2c2-205f-46a0-aa3a-c0f179f2ac23 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:31.125083 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fb2c2-205f-46a0-aa3a-c0f179f2ac23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:31.125401 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fb2c2-205f-46a0-aa3a-c0f179f2ac23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:31.127025 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fb2c2-205f-46a0-aa3a-c0f179f2ac23 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:31.140319 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 59/116] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:30:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:31.140319 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fb2c2-205f-46a0-aa3a-c0f179f2ac23 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:31.239370 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3951e29-7dab-4d05-8742-6a7e42f3f6c6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:31.273399 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:31.277512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fb2c2-205f-46a0-aa3a-c0f179f2ac23 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:31.281963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e38ab6-40b8-496f-973a-053952fbc874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:31.283092 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e38ab6-40b8-496f-973a-053952fbc874 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:31.284102 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e38ab6-40b8-496f-973a-053952fbc874 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:31.284608 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e38ab6-40b8-496f-973a-053952fbc874 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:31.306201 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e38ab6-40b8-496f-973a-053952fbc874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-66e38ab6-40b8-496f-973a-053952fbc874 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:31.316354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:31.317555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:31.318694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:31.318694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:31.318694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:31.318694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:31.318694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:31.318694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:31.318694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:31.318694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:31.318694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:31.318694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:31.318694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:30:31.318694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:30:31.318694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 58/117] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:30:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:31.318694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e38ab6-40b8-496f-973a-053952fbc874 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:31.335461 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e67a67-508e-4d28-b5d3-79e3d6c84ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:31.336504 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e67a67-508e-4d28-b5d3-79e3d6c84ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:31.336504 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e67a67-508e-4d28-b5d3-79e3d6c84ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:31.342172 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e67a67-508e-4d28-b5d3-79e3d6c84ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:31.342172 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e67a67-508e-4d28-b5d3-79e3d6c84ff0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:31.342172 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e67a67-508e-4d28-b5d3-79e3d6c84ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:31.342172 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e67a67-508e-4d28-b5d3-79e3d6c84ff0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:31.362522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 60/118] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:31.362522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3848ecb-ca9f-4431-95fd-857952b3e057 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:31.362522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3848ecb-ca9f-4431-95fd-857952b3e057 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:31.362522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3848ecb-ca9f-4431-95fd-857952b3e057 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:31.362522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 61/119] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:31.363686 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3848ecb-ca9f-4431-95fd-857952b3e057 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:31.365480 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:31.523106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e38ab6-40b8-496f-973a-053952fbc874 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:31.523337 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3848ecb-ca9f-4431-95fd-857952b3e057 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:31.569206 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b993b-3466-4871-8bac-73993e73b0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:31.570188 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b993b-3466-4871-8bac-73993e73b0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:31.570550 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b993b-3466-4871-8bac-73993e73b0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:31.572187 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b993b-3466-4871-8bac-73993e73b0d2 None admin] PATH_INFO: `/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:31.572187 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b993b-3466-4871-8bac-73993e73b0d2 None admin] RBAC: Authorizing `identity:get_user(user_id=bd892ec4fbfa4f31bcd7d81f7be2ea09)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:31.573656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b993b-3466-4871-8bac-73993e73b0d2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:31.580801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 62/120] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:31 2022] GET /identity/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:31.580801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b993b-3466-4871-8bac-73993e73b0d2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:31.583187 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9544a-b7af-45f9-ae82-6c2652549ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:31.584218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9544a-b7af-45f9-ae82-6c2652549ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:31.584645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9544a-b7af-45f9-ae82-6c2652549ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:31.585224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9544a-b7af-45f9-ae82-6c2652549ab2 None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:31.586888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9544a-b7af-45f9-ae82-6c2652549ab2 None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:31.588614 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9544a-b7af-45f9-ae82-6c2652549ab2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:31.591244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 59/121] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:31 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:31.593064 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5541f-c3d8-4d4c-8974-2a1a40c3efb6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:31.593545 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5541f-c3d8-4d4c-8974-2a1a40c3efb6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:31.593851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5541f-c3d8-4d4c-8974-2a1a40c3efb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:31.623707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:31.630417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-24e5541f-c3d8-4d4c-8974-2a1a40c3efb6 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:31.632760 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-24e5541f-c3d8-4d4c-8974-2a1a40c3efb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:31.742223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 60/122] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:31.751778 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5541f-c3d8-4d4c-8974-2a1a40c3efb6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:31.773240 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b993b-3466-4871-8bac-73993e73b0d2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:31.792469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:31.826206 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4a98b-9439-41d2-b1b8-d3f9f28bf89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:31.827717 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4a98b-9439-41d2-b1b8-d3f9f28bf89b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:31.827717 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4a98b-9439-41d2-b1b8-d3f9f28bf89b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:31.827717 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4a98b-9439-41d2-b1b8-d3f9f28bf89b None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:31.828502 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4a98b-9439-41d2-b1b8-d3f9f28bf89b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:31.829114 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4a98b-9439-41d2-b1b8-d3f9f28bf89b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:31.830631 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4a98b-9439-41d2-b1b8-d3f9f28bf89b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:31.851910 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 63/123] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:30:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:31.851910 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4a98b-9439-41d2-b1b8-d3f9f28bf89b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:31.928668 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5541f-c3d8-4d4c-8974-2a1a40c3efb6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:31.986316 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a3f02-f443-4b75-861d-c087864c4ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:31.987394 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a3f02-f443-4b75-861d-c087864c4ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:31.987686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a3f02-f443-4b75-861d-c087864c4ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:31.987972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a3f02-f443-4b75-861d-c087864c4ff9 None admin] PATH_INFO: `/v3/users/99cee851d5f84c3782ff1a60b5667a3d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:31.989358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a3f02-f443-4b75-861d-c087864c4ff9 None admin] RBAC: Authorizing `identity:get_user(user_id=99cee851d5f84c3782ff1a60b5667a3d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:31.990913 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a3f02-f443-4b75-861d-c087864c4ff9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:31.992823 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:31.998676 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 61/124] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:31 2022] GET /identity/v3/users/99cee851d5f84c3782ff1a60b5667a3d => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:31.999547 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a3f02-f443-4b75-861d-c087864c4ff9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:32.010637 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4a98b-9439-41d2-b1b8-d3f9f28bf89b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:32.062703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917296e-c0aa-4eaa-9355-23a584cb44bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:32.063625 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917296e-c0aa-4eaa-9355-23a584cb44bd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:32.063921 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917296e-c0aa-4eaa-9355-23a584cb44bd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:32.064208 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917296e-c0aa-4eaa-9355-23a584cb44bd None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:32.065797 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917296e-c0aa-4eaa-9355-23a584cb44bd None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:32.067426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917296e-c0aa-4eaa-9355-23a584cb44bd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:32.081391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 64/125] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:31 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:32.081391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917296e-c0aa-4eaa-9355-23a584cb44bd None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:32.170964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:32.191664 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a3f02-f443-4b75-861d-c087864c4ff9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:32.250696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917296e-c0aa-4eaa-9355-23a584cb44bd None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:32.280430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ede7d-3cf6-4dd6-bd62-149bdc39922f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:32.281806 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ede7d-3cf6-4dd6-bd62-149bdc39922f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:32.282290 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ede7d-3cf6-4dd6-bd62-149bdc39922f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:32.282838 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ede7d-3cf6-4dd6-bd62-149bdc39922f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:32.285044 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ede7d-3cf6-4dd6-bd62-149bdc39922f None admin] RBAC: Adding query filter params (role.id=50aac635500847d795e12adf460cbe94, scope.project.id=50c4a61b8f494e029afaea135bfd4777, user.id=b2d8a96f1c6d468dbd3633d2c68d6bfa) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:32.285615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ede7d-3cf6-4dd6-bd62-149bdc39922f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:32.288588 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ede7d-3cf6-4dd6-bd62-149bdc39922f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:32.306593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 62/126] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:31 2022] GET /identity/v3/role_assignments?user.id=b2d8a96f1c6d468dbd3633d2c68d6bfa&scope.project.id=50c4a61b8f494e029afaea135bfd4777&role.id=50aac635500847d795e12adf460cbe94 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:32.306593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ede7d-3cf6-4dd6-bd62-149bdc39922f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:32.308253 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2600228-1d4a-4f0e-87d9-16844f708b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:32.310125 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600228-1d4a-4f0e-87d9-16844f708b99 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:32.319387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600228-1d4a-4f0e-87d9-16844f708b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:32.319977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600228-1d4a-4f0e-87d9-16844f708b99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:32.367896 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2600228-1d4a-4f0e-87d9-16844f708b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-c2600228-1d4a-4f0e-87d9-16844f708b99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:32.390911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:32.392636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:32.395458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:32.395458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:32.395458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:32.395458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:32.395458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:32.395458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:32.395458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:32.395458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:32.395458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:32.395458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:32.395458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:32.395458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:32.395458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 65/127] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:32.395458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2600228-1d4a-4f0e-87d9-16844f708b99 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:32.477240 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:32.617760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2600228-1d4a-4f0e-87d9-16844f708b99 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:32.620101 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ede7d-3cf6-4dd6-bd62-149bdc39922f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:32.658916 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850afecf-bce2-4ae6-8299-febb70f0d25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:32.660109 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850afecf-bce2-4ae6-8299-febb70f0d25c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:32.660449 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850afecf-bce2-4ae6-8299-febb70f0d25c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:32.660797 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850afecf-bce2-4ae6-8299-febb70f0d25c None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:32.663572 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850afecf-bce2-4ae6-8299-febb70f0d25c None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:32.665160 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850afecf-bce2-4ae6-8299-febb70f0d25c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:32.667432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 66/128] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:32 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:32.668015 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850afecf-bce2-4ae6-8299-febb70f0d25c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:32.686130 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d137df2-a51b-493f-a230-d7a10da16953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:32.688162 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d137df2-a51b-493f-a230-d7a10da16953 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:32.688919 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d137df2-a51b-493f-a230-d7a10da16953 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:32.690188 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d137df2-a51b-493f-a230-d7a10da16953 None admin] PATH_INFO: `/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:32.692699 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d137df2-a51b-493f-a230-d7a10da16953 None admin] RBAC: Authorizing `identity:get_user(user_id=bd892ec4fbfa4f31bcd7d81f7be2ea09)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:32.695203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d137df2-a51b-493f-a230-d7a10da16953 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:32.697928 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 63/129] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:32 2022] GET /identity/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09 => generated 275 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:32.706175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d137df2-a51b-493f-a230-d7a10da16953 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:32.759300 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:32.783171 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:32.802133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850afecf-bce2-4ae6-8299-febb70f0d25c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:32.848100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8660dc1-d9fc-4d60-887d-6331755f513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:32.849000 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8660dc1-d9fc-4d60-887d-6331755f513a None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:32.849321 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8660dc1-d9fc-4d60-887d-6331755f513a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:32.849574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8660dc1-d9fc-4d60-887d-6331755f513a None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777/users/bd892ec4fbfa4f31bcd7d81f7be2ea09/roles/edcc1e17fab74f2d93941e3c37b66546` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:32.851853 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8660dc1-d9fc-4d60-887d-6331755f513a None admin] RBAC: Authorizing `identity:create_grant(project_id=50c4a61b8f494e029afaea135bfd4777, user_id=bd892ec4fbfa4f31bcd7d81f7be2ea09, role_id=edcc1e17fab74f2d93941e3c37b66546)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:32.853350 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8660dc1-d9fc-4d60-887d-6331755f513a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:32.866625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d137df2-a51b-493f-a230-d7a10da16953 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:32.872372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 67/130] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:30:32 2022] PUT /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777/users/bd892ec4fbfa4f31bcd7d81f7be2ea09/roles/edcc1e17fab74f2d93941e3c37b66546 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:30:32.873647 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce802276-148f-41c3-a7bc-ba7d6816b781 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:32.873940 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce802276-148f-41c3-a7bc-ba7d6816b781 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:32.874228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce802276-148f-41c3-a7bc-ba7d6816b781 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:32.878564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 68/131] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:32.881888 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce802276-148f-41c3-a7bc-ba7d6816b781 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:32.919077 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b872a0d-b797-4b50-a87d-4c9e6aac49ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:32.920077 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b872a0d-b797-4b50-a87d-4c9e6aac49ce None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:32.920567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b872a0d-b797-4b50-a87d-4c9e6aac49ce None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:32.921129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b872a0d-b797-4b50-a87d-4c9e6aac49ce None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:32.922110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b872a0d-b797-4b50-a87d-4c9e6aac49ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:32.922712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b872a0d-b797-4b50-a87d-4c9e6aac49ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:32.925132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b872a0d-b797-4b50-a87d-4c9e6aac49ce None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:32.936183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 64/132] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:30:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:32.937547 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b872a0d-b797-4b50-a87d-4c9e6aac49ce None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:33.065798 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce802276-148f-41c3-a7bc-ba7d6816b781 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:33.076226 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:33.102619 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b872a0d-b797-4b50-a87d-4c9e6aac49ce None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:33.149578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2a2db-3ae1-4e75-85ef-164d061b7094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:33.151134 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2a2db-3ae1-4e75-85ef-164d061b7094 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:33.151641 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2a2db-3ae1-4e75-85ef-164d061b7094 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:33.152200 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2a2db-3ae1-4e75-85ef-164d061b7094 None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:33.155174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2a2db-3ae1-4e75-85ef-164d061b7094 None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:33.159290 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2a2db-3ae1-4e75-85ef-164d061b7094 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:33.161893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 65/133] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:32 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:33.164501 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148fd5f-5fe7-4470-9abe-e31bf3109664 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:33.165040 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148fd5f-5fe7-4470-9abe-e31bf3109664 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:33.165552 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148fd5f-5fe7-4470-9abe-e31bf3109664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:33.171434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ec82f-98aa-4b97-bfa6-f74627a18d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:33.173573 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ec82f-98aa-4b97-bfa6-f74627a18d6d None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:33.173573 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ec82f-98aa-4b97-bfa6-f74627a18d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:33.175164 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ec82f-98aa-4b97-bfa6-f74627a18d6d None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777/users/99cee851d5f84c3782ff1a60b5667a3d/roles/efaf387c51e14931820f2a9b33ac5175` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:33.180251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ec82f-98aa-4b97-bfa6-f74627a18d6d None admin] RBAC: Authorizing `identity:create_grant(project_id=50c4a61b8f494e029afaea135bfd4777, user_id=99cee851d5f84c3782ff1a60b5667a3d, role_id=efaf387c51e14931820f2a9b33ac5175)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:33.182612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ec82f-98aa-4b97-bfa6-f74627a18d6d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:33.191012 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c148fd5f-5fe7-4470-9abe-e31bf3109664 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:33.193284 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c148fd5f-5fe7-4470-9abe-e31bf3109664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:33.220043 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 69/134] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:30:32 2022] PUT /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777/users/99cee851d5f84c3782ff1a60b5667a3d/roles/efaf387c51e14931820f2a9b33ac5175 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:30:33.222892 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ec82f-98aa-4b97-bfa6-f74627a18d6d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:33.263665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:33.397175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 66/135] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:33.407677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148fd5f-5fe7-4470-9abe-e31bf3109664 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:33.515325 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ec82f-98aa-4b97-bfa6-f74627a18d6d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:33.612909 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0a810-4392-4555-bce1-8164292c11e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:33.619330 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0a810-4392-4555-bce1-8164292c11e3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:33.620184 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0a810-4392-4555-bce1-8164292c11e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:33.621023 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0a810-4392-4555-bce1-8164292c11e3 None admin] PATH_INFO: `/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:33.623733 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0a810-4392-4555-bce1-8164292c11e3 None admin] RBAC: Authorizing `identity:get_user(user_id=bd892ec4fbfa4f31bcd7d81f7be2ea09)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:33.632340 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0a810-4392-4555-bce1-8164292c11e3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:33.642963 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 70/136] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:33 2022] GET /identity/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09 => generated 275 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:33.645201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0a810-4392-4555-bce1-8164292c11e3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:33.782909 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:33.879351 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148fd5f-5fe7-4470-9abe-e31bf3109664 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:33.928438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:33.969763 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646adf7-652f-48e4-b357-208a659e024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:33.971870 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646adf7-652f-48e4-b357-208a659e024a None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:33.972964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646adf7-652f-48e4-b357-208a659e024a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:33.973722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646adf7-652f-48e4-b357-208a659e024a None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777/users/bd892ec4fbfa4f31bcd7d81f7be2ea09/roles/f0b3744c39ca4eb7b78ef642c0175a0a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:33.977967 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646adf7-652f-48e4-b357-208a659e024a None admin] RBAC: Authorizing `identity:create_grant(project_id=50c4a61b8f494e029afaea135bfd4777, user_id=bd892ec4fbfa4f31bcd7d81f7be2ea09, role_id=f0b3744c39ca4eb7b78ef642c0175a0a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:33.981186 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646adf7-652f-48e4-b357-208a659e024a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:34.018194 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 67/137] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:30:33 2022] PUT /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777/users/bd892ec4fbfa4f31bcd7d81f7be2ea09/roles/f0b3744c39ca4eb7b78ef642c0175a0a => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:30:34.020364 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646adf7-652f-48e4-b357-208a659e024a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:34.054338 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0a810-4392-4555-bce1-8164292c11e3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:34.205649 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31328647-873f-49ac-8c36-4680c8473574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:34.207724 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328647-873f-49ac-8c36-4680c8473574 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:34.208602 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328647-873f-49ac-8c36-4680c8473574 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:34.209377 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328647-873f-49ac-8c36-4680c8473574 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:34.213850 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31328647-873f-49ac-8c36-4680c8473574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:34.221208 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31328647-873f-49ac-8c36-4680c8473574 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:34.226249 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 71/138] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:30:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 582 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:34.238785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31328647-873f-49ac-8c36-4680c8473574 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:34.346884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646adf7-652f-48e4-b357-208a659e024a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:34.500656 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75f05d-5ccd-4b29-90ec-d83e6bff6792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:34.503272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75f05d-5ccd-4b29-90ec-d83e6bff6792 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:34.504011 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75f05d-5ccd-4b29-90ec-d83e6bff6792 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:34.504719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75f05d-5ccd-4b29-90ec-d83e6bff6792 None admin] PATH_INFO: `/v3/projects/00474714affc48678578060800edd2ae` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:34.511344 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75f05d-5ccd-4b29-90ec-d83e6bff6792 None admin] RBAC: Authorizing `identity:get_project(project_id=00474714affc48678578060800edd2ae)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:34.522597 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75f05d-5ccd-4b29-90ec-d83e6bff6792 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:34.532783 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 68/139] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:34 2022] GET /identity/v3/projects/00474714affc48678578060800edd2ae => generated 312 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:34.549527 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75f05d-5ccd-4b29-90ec-d83e6bff6792 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:34.580249 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:34.641068 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31328647-873f-49ac-8c36-4680c8473574 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:34.813780 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50478a8c-51fc-4663-a4b0-70c79dcda71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:34.814545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50478a8c-51fc-4663-a4b0-70c79dcda71b None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:34.814846 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50478a8c-51fc-4663-a4b0-70c79dcda71b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:34.815135 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50478a8c-51fc-4663-a4b0-70c79dcda71b None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:34.815885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50478a8c-51fc-4663-a4b0-70c79dcda71b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:34.817482 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50478a8c-51fc-4663-a4b0-70c79dcda71b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:34.832656 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75f05d-5ccd-4b29-90ec-d83e6bff6792 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:34.868687 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:34.895098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 72/140] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:30:34 2022] POST /identity/v3/users => generated 283 bytes in 657 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:30:34.964325 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a31fda-78c5-4a43-a784-417976189cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:34.965900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a31fda-78c5-4a43-a784-417976189cc9 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:34.966393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a31fda-78c5-4a43-a784-417976189cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:34.966893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a31fda-78c5-4a43-a784-417976189cc9 None admin] PATH_INFO: `/v3/projects/00474714affc48678578060800edd2ae/users/bd892ec4fbfa4f31bcd7d81f7be2ea09/roles/edcc1e17fab74f2d93941e3c37b66546` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:34.975329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a31fda-78c5-4a43-a784-417976189cc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=00474714affc48678578060800edd2ae, user_id=bd892ec4fbfa4f31bcd7d81f7be2ea09, role_id=edcc1e17fab74f2d93941e3c37b66546)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:34.978019 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a31fda-78c5-4a43-a784-417976189cc9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:35.036032 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 69/141] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:30:34 2022] PUT /identity/v3/projects/00474714affc48678578060800edd2ae/users/bd892ec4fbfa4f31bcd7d81f7be2ea09/roles/edcc1e17fab74f2d93941e3c37b66546 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:30:36.994731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9b225-97eb-446d-9fb5-b8afcd6a2641 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:36.994731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9b225-97eb-446d-9fb5-b8afcd6a2641 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:36.994731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9b225-97eb-446d-9fb5-b8afcd6a2641 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:36.995824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 73/142] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:37.006547 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc54912-e13c-4943-8616-5e9decc4a178 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:37.006547 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc54912-e13c-4943-8616-5e9decc4a178 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:37.006547 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc54912-e13c-4943-8616-5e9decc4a178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:37.056136 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ddc54912-e13c-4943-8616-5e9decc4a178 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:37.058724 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ddc54912-e13c-4943-8616-5e9decc4a178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:37.213546 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 70/143] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:37.214004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:37.282324 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9b225-97eb-446d-9fb5-b8afcd6a2641 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:37.354098 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200a528-065d-4bf1-85c8-ec1e82922eef None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:37.354846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200a528-065d-4bf1-85c8-ec1e82922eef None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:37.355336 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200a528-065d-4bf1-85c8-ec1e82922eef None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:37.357277 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 71/144] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:37.381814 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7409db-1c41-42d8-a3c5-216777ef0f5f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:37.381814 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7409db-1c41-42d8-a3c5-216777ef0f5f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:37.381814 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7409db-1c41-42d8-a3c5-216777ef0f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:37.424554 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2f7409db-1c41-42d8-a3c5-216777ef0f5f None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:37.426249 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2f7409db-1c41-42d8-a3c5-216777ef0f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:37.584166 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 72/145] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:30:37.623747 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7409db-1c41-42d8-a3c5-216777ef0f5f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:37.814636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9b225-97eb-446d-9fb5-b8afcd6a2641 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:38.009724 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda4341-c25f-445f-9d27-aeb17a910eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:38.012598 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda4341-c25f-445f-9d27-aeb17a910eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:38.013495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda4341-c25f-445f-9d27-aeb17a910eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:38.014307 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda4341-c25f-445f-9d27-aeb17a910eb9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:38.033358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7409db-1c41-42d8-a3c5-216777ef0f5f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:38.059697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda4341-c25f-445f-9d27-aeb17a910eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7eda4341-c25f-445f-9d27-aeb17a910eb9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:38.084140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:38.085051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:38.085964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:38.085964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:38.085964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:38.085964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:38.085964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:38.085964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:38.085964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:38.085964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:38.085964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:38.085964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:38.085964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:30:38.085964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:38.086638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 74/146] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 806 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:38.100371 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda4341-c25f-445f-9d27-aeb17a910eb9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:38.121974 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:38.167105 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e3cf3-560a-44fb-97cc-0a1e858cd897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:38.168415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3cf3-560a-44fb-97cc-0a1e858cd897 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:38.169034 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3cf3-560a-44fb-97cc-0a1e858cd897 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:38.169567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3cf3-560a-44fb-97cc-0a1e858cd897 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:38.217229 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e3cf3-560a-44fb-97cc-0a1e858cd897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-cc5e3cf3-560a-44fb-97cc-0a1e858cd897 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:38.225900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:38.226855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:38.227647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:38.227647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:38.227647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:38.227647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:38.227647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:38.227647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:38.227647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:38.227647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:38.227647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:38.227647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:38.227647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:38.227647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:30:38.230276 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 73/147] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 607 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:38.237507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e3cf3-560a-44fb-97cc-0a1e858cd897 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:38.350319 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:38.507337 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda4341-c25f-445f-9d27-aeb17a910eb9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:38.621445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf693b-f479-49ce-8358-5e1a85ca0bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:38.622485 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf693b-f479-49ce-8358-5e1a85ca0bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:38.622933 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e3cf3-560a-44fb-97cc-0a1e858cd897 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:38.623107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf693b-f479-49ce-8358-5e1a85ca0bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:38.623441 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf693b-f479-49ce-8358-5e1a85ca0bd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:38.626523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf693b-f479-49ce-8358-5e1a85ca0bd2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:38.626523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf693b-f479-49ce-8358-5e1a85ca0bd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:38.629224 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf693b-f479-49ce-8358-5e1a85ca0bd2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:38.669529 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 75/148] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:30:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 570 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:38.670982 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa057834-cdef-4e7d-a1dc-336ba8991cba None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:38.671280 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa057834-cdef-4e7d-a1dc-336ba8991cba None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:38.674212 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa057834-cdef-4e7d-a1dc-336ba8991cba None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:38.675560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 76/149] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:38.685351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c081-72d6-4893-98ba-df8fd01401e4 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:38.685726 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c081-72d6-4893-98ba-df8fd01401e4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:38.685962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c081-72d6-4893-98ba-df8fd01401e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:38.728018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ab92c081-72d6-4893-98ba-df8fd01401e4 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:38.730736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ab92c081-72d6-4893-98ba-df8fd01401e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:38.775350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd369060-7f6e-4937-9a8f-84d285901a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:38.776061 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd369060-7f6e-4937-9a8f-84d285901a6d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:38.776356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd369060-7f6e-4937-9a8f-84d285901a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:38.776801 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd369060-7f6e-4937-9a8f-84d285901a6d None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:38.777587 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd369060-7f6e-4937-9a8f-84d285901a6d None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:38.777903 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd369060-7f6e-4937-9a8f-84d285901a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:38.786548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd369060-7f6e-4937-9a8f-84d285901a6d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:38.817430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 74/150] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:30:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 580 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:38.818370 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd369060-7f6e-4937-9a8f-84d285901a6d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:39.009219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 77/151] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:39.011192 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c081-72d6-4893-98ba-df8fd01401e4 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:39.029442 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:39.186526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:39.284642 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd369060-7f6e-4937-9a8f-84d285901a6d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:39.394139 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c081-72d6-4893-98ba-df8fd01401e4 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:39.450244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3e4fd-1d94-48c7-baea-543e33d7e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:39.450244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3e4fd-1d94-48c7-baea-543e33d7e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:39.450244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3e4fd-1d94-48c7-baea-543e33d7e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:39.450244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3e4fd-1d94-48c7-baea-543e33d7e8e0 None admin] PATH_INFO: `/v3/users/b2d8a96f1c6d468dbd3633d2c68d6bfa` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:39.456699 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3e4fd-1d94-48c7-baea-543e33d7e8e0 None admin] RBAC: Authorizing `identity:get_user(user_id=b2d8a96f1c6d468dbd3633d2c68d6bfa)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:39.459501 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3e4fd-1d94-48c7-baea-543e33d7e8e0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:39.464070 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 75/152] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:38 2022] GET /identity/v3/users/b2d8a96f1c6d468dbd3633d2c68d6bfa => generated 289 bytes in 646 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:39.465603 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3e4fd-1d94-48c7-baea-543e33d7e8e0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:39.495253 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c10f8-29db-48fc-af56-dce266c3e5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:39.496177 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c10f8-29db-48fc-af56-dce266c3e5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:39.496470 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c10f8-29db-48fc-af56-dce266c3e5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:39.496756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c10f8-29db-48fc-af56-dce266c3e5f4 None admin] PATH_INFO: `/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:39.503418 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c10f8-29db-48fc-af56-dce266c3e5f4 None admin] RBAC: Authorizing `identity:get_user(user_id=bd892ec4fbfa4f31bcd7d81f7be2ea09)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:39.504948 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c10f8-29db-48fc-af56-dce266c3e5f4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:39.506855 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 78/153] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:39 2022] GET /identity/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09 => generated 275 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:39.507706 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c10f8-29db-48fc-af56-dce266c3e5f4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:39.722554 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c10f8-29db-48fc-af56-dce266c3e5f4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:39.766945 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:39.800473 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b621626-9db8-4da0-b3c5-16afd522c5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:39.801301 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b621626-9db8-4da0-b3c5-16afd522c5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:39.801594 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b621626-9db8-4da0-b3c5-16afd522c5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:39.801876 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b621626-9db8-4da0-b3c5-16afd522c5a5 None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:39.807441 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b621626-9db8-4da0-b3c5-16afd522c5a5 None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:39.808951 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b621626-9db8-4da0-b3c5-16afd522c5a5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:39.811293 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 79/154] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:39 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:39.811894 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b621626-9db8-4da0-b3c5-16afd522c5a5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:39.999621 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b621626-9db8-4da0-b3c5-16afd522c5a5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:40.057015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3e4fd-1d94-48c7-baea-543e33d7e8e0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:40.086473 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5f42a-3f9f-4ad6-bdfc-b77415649f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:40.087405 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5f42a-3f9f-4ad6-bdfc-b77415649f22 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:40.087658 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5f42a-3f9f-4ad6-bdfc-b77415649f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:40.087933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5f42a-3f9f-4ad6-bdfc-b77415649f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:40.138368 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:40.196793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e158b7a-5945-4321-bde3-75b244c8e433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:40.197675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e158b7a-5945-4321-bde3-75b244c8e433 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:40.198104 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e158b7a-5945-4321-bde3-75b244c8e433 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:40.200457 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e158b7a-5945-4321-bde3-75b244c8e433 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:40.236752 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e158b7a-5945-4321-bde3-75b244c8e433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-3e158b7a-5945-4321-bde3-75b244c8e433 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:40.260563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:40.261658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:40.263014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:40.263014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:40.263014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:40.263014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:40.263014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:40.263014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:40.263014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:40.263014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:40.263014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:40.263014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:40.263014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:40.263014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:30:40.267852 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 76/155] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:30:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 803 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:40.268848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e158b7a-5945-4321-bde3-75b244c8e433 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:40.279246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:40.314827 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5f42a-3f9f-4ad6-bdfc-b77415649f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:40.316329 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5f42a-3f9f-4ad6-bdfc-b77415649f22 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:40.483441 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 80/156] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:30:40.485021 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5fb18-76bf-4034-9b0e-f80516920eb3 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:40.485353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5fb18-76bf-4034-9b0e-f80516920eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:40.485646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5fb18-76bf-4034-9b0e-f80516920eb3 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:40.487534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 81/157] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:40.489044 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5fb18-76bf-4034-9b0e-f80516920eb3 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:40.528577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e158b7a-5945-4321-bde3-75b244c8e433 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:40.666670 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98395b92-ab37-4273-a30f-0d11b4e2394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:40.666670 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98395b92-ab37-4273-a30f-0d11b4e2394a None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:40.666670 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98395b92-ab37-4273-a30f-0d11b4e2394a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:40.667118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98395b92-ab37-4273-a30f-0d11b4e2394a None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777/users/b2d8a96f1c6d468dbd3633d2c68d6bfa/roles/50aac635500847d795e12adf460cbe94` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:40.672386 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98395b92-ab37-4273-a30f-0d11b4e2394a None admin] RBAC: Authorizing `identity:create_grant(project_id=50c4a61b8f494e029afaea135bfd4777, user_id=b2d8a96f1c6d468dbd3633d2c68d6bfa, role_id=50aac635500847d795e12adf460cbe94)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:40.678548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98395b92-ab37-4273-a30f-0d11b4e2394a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:40.725581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:40.741347 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 77/158] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:30:40 2022] PUT /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777/users/b2d8a96f1c6d468dbd3633d2c68d6bfa/roles/50aac635500847d795e12adf460cbe94 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:30:40.743092 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b06ff-c239-42e9-b850-b750ba09ede4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:40.743092 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b06ff-c239-42e9-b850-b750ba09ede4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:40.743389 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b06ff-c239-42e9-b850-b750ba09ede4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:40.744955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 78/159] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:40.745762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b06ff-c239-42e9-b850-b750ba09ede4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:40.780963 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5fb18-76bf-4034-9b0e-f80516920eb3 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:40.862787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:40.884619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba447af-972a-4d79-ba36-386053c02d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:40.885661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba447af-972a-4d79-ba36-386053c02d4b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:40.886093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba447af-972a-4d79-ba36-386053c02d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:40.886530 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba447af-972a-4d79-ba36-386053c02d4b None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:40.888720 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba447af-972a-4d79-ba36-386053c02d4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:40.889829 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba447af-972a-4d79-ba36-386053c02d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:40.897490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba447af-972a-4d79-ba36-386053c02d4b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:40.930185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 82/160] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:40.932422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff01a94-e885-417a-a3c1-636498413931 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:40.932921 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff01a94-e885-417a-a3c1-636498413931 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:40.933461 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff01a94-e885-417a-a3c1-636498413931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:40.992234 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8ff01a94-e885-417a-a3c1-636498413931 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:40.994138 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8ff01a94-e885-417a-a3c1-636498413931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:41.076556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b06ff-c239-42e9-b850-b750ba09ede4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:41.177187 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4713c1-109e-4bcf-a6ae-af389a485d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:41.178146 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4713c1-109e-4bcf-a6ae-af389a485d9d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:41.178419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4713c1-109e-4bcf-a6ae-af389a485d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:41.180303 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4713c1-109e-4bcf-a6ae-af389a485d9d None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:41.182242 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 83/161] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:41.183758 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4a5e-9326-4148-be77-37ff15d2134f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:41.184055 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4a5e-9326-4148-be77-37ff15d2134f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:41.184336 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4a5e-9326-4148-be77-37ff15d2134f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:41.191611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4713c1-109e-4bcf-a6ae-af389a485d9d None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:41.193313 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4713c1-109e-4bcf-a6ae-af389a485d9d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:41.202656 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 79/162] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:40 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:41.203626 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4713c1-109e-4bcf-a6ae-af389a485d9d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:41.239989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-731a4a5e-9326-4148-be77-37ff15d2134f None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:41.241255 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-731a4a5e-9326-4148-be77-37ff15d2134f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:41.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 84/163] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:41.356221 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d6dd-c7c9-47ea-b0bc-698f4b26c614 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:41.356514 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d6dd-c7c9-47ea-b0bc-698f4b26c614 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:41.356790 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1d6dd-c7c9-47ea-b0bc-698f4b26c614 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:41.358541 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 85/164] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:41.359338 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1d6dd-c7c9-47ea-b0bc-698f4b26c614 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:41.381140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:41.387044 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4713c1-109e-4bcf-a6ae-af389a485d9d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:41.414528 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:41.476814 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e1dd6-981f-40d0-96cf-f4626176a819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:41.477692 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e1dd6-981f-40d0-96cf-f4626176a819 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:41.477985 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e1dd6-981f-40d0-96cf-f4626176a819 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:41.478255 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e1dd6-981f-40d0-96cf-f4626176a819 None admin] PATH_INFO: `/v3/users/99cee851d5f84c3782ff1a60b5667a3d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:41.484118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e1dd6-981f-40d0-96cf-f4626176a819 None admin] RBAC: Authorizing `identity:get_user(user_id=99cee851d5f84c3782ff1a60b5667a3d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:41.486262 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e1dd6-981f-40d0-96cf-f4626176a819 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:41.488435 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 80/165] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:41 2022] GET /identity/v3/users/99cee851d5f84c3782ff1a60b5667a3d => generated 247 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:41.497932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e1dd6-981f-40d0-96cf-f4626176a819 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:41.655393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e1dd6-981f-40d0-96cf-f4626176a819 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:41.695225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1d6dd-c7c9-47ea-b0bc-698f4b26c614 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:41.719365 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f1618-965f-44f1-b6b4-2dc5af3b1743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:41.722073 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f1618-965f-44f1-b6b4-2dc5af3b1743 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:41.723907 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f1618-965f-44f1-b6b4-2dc5af3b1743 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:41.724806 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f1618-965f-44f1-b6b4-2dc5af3b1743 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:41.754375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f1618-965f-44f1-b6b4-2dc5af3b1743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d84f1618-965f-44f1-b6b4-2dc5af3b1743 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:41.776181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:41.777885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:41.789120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:41.789120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:41.789120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:41.789120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:41.789120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:41.789120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:41.789120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:41.789120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:41.789120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:41.789120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:41.789120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:30:41.789120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:30:41.789120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 81/166] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:30:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:41.789120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e74da-16bf-4298-84bf-00b00083e191 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:41.798024 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e74da-16bf-4298-84bf-00b00083e191 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:41.798024 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e74da-16bf-4298-84bf-00b00083e191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:41.811699 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67efe90-9980-4228-b7ca-4af66b060e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:41.812665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67efe90-9980-4228-b7ca-4af66b060e2f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:41.813103 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67efe90-9980-4228-b7ca-4af66b060e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:41.813651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67efe90-9980-4228-b7ca-4af66b060e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:41.814966 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67efe90-9980-4228-b7ca-4af66b060e2f None admin] RBAC: Adding query filter params (role.id=edcc1e17fab74f2d93941e3c37b66546, scope.project.id=50c4a61b8f494e029afaea135bfd4777, user.id=bd892ec4fbfa4f31bcd7d81f7be2ea09) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:41.819553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67efe90-9980-4228-b7ca-4af66b060e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:41.823239 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67efe90-9980-4228-b7ca-4af66b060e2f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:41.839386 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-975e74da-16bf-4298-84bf-00b00083e191 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:41.847479 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-975e74da-16bf-4298-84bf-00b00083e191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:41.850565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 86/167] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:41 2022] GET /identity/v3/role_assignments?user.id=bd892ec4fbfa4f31bcd7d81f7be2ea09&scope.project.id=50c4a61b8f494e029afaea135bfd4777&role.id=edcc1e17fab74f2d93941e3c37b66546 => generated 608 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:41.855420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67efe90-9980-4228-b7ca-4af66b060e2f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:41.896322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:41.998888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 82/168] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:42.000222 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e74da-16bf-4298-84bf-00b00083e191 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:42.072959 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:42.133810 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67efe90-9980-4228-b7ca-4af66b060e2f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:42.187065 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149c438-3d18-4617-87ca-9a44b7723ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:42.188908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149c438-3d18-4617-87ca-9a44b7723ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:42.190009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149c438-3d18-4617-87ca-9a44b7723ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:42.190456 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149c438-3d18-4617-87ca-9a44b7723ec8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:42.206862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e74da-16bf-4298-84bf-00b00083e191 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:42.216714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149c438-3d18-4617-87ca-9a44b7723ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7149c438-3d18-4617-87ca-9a44b7723ec8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:42.227801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:42.228749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:42.229534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:42.229534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:42.229534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:42.229534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:42.229534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:42.229534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:42.229534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:42.229534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:42.229534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:42.229534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:42.229534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:42.229534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:42.229534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 87/169] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:30:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:42.231044 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d17f4-449a-43b8-9ec7-615650e0bc14 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:42.231341 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d17f4-449a-43b8-9ec7-615650e0bc14 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:42.231624 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d17f4-449a-43b8-9ec7-615650e0bc14 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:42.233071 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 88/170] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:42.233878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d17f4-449a-43b8-9ec7-615650e0bc14 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:42.273112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5db7eb-9db7-41d1-9f5e-8f4102bf7cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:42.273315 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5db7eb-9db7-41d1-9f5e-8f4102bf7cbf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:42.273523 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5db7eb-9db7-41d1-9f5e-8f4102bf7cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:42.273760 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5db7eb-9db7-41d1-9f5e-8f4102bf7cbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:42.326833 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:42.395763 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5db7eb-9db7-41d1-9f5e-8f4102bf7cbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:42.397569 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5db7eb-9db7-41d1-9f5e-8f4102bf7cbf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:42.397931 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d17f4-449a-43b8-9ec7-615650e0bc14 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:42.434880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:42.447344 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbe7a6-15cf-4f81-8987-ef93fcc103b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:42.448036 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbe7a6-15cf-4f81-8987-ef93fcc103b7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:42.448333 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbe7a6-15cf-4f81-8987-ef93fcc103b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:42.448615 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbe7a6-15cf-4f81-8987-ef93fcc103b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:42.449394 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbe7a6-15cf-4f81-8987-ef93fcc103b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:42.449705 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbe7a6-15cf-4f81-8987-ef93fcc103b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:42.451204 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbe7a6-15cf-4f81-8987-ef93fcc103b7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:42.461764 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 89/171] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:30:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:42.467118 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbe7a6-15cf-4f81-8987-ef93fcc103b7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:42.567294 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 83/172] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:30:42.568646 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff524ed6-f0ac-4018-ae69-548ed73f92c4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:42.568934 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff524ed6-f0ac-4018-ae69-548ed73f92c4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:42.569214 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff524ed6-f0ac-4018-ae69-548ed73f92c4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:42.570683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 84/173] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:42.571766 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035b774-5f82-4f0f-84d3-bae3341ece33 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:42.572048 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035b774-5f82-4f0f-84d3-bae3341ece33 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:42.572324 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035b774-5f82-4f0f-84d3-bae3341ece33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:42.596683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b035b774-5f82-4f0f-84d3-bae3341ece33 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:42.597147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b035b774-5f82-4f0f-84d3-bae3341ece33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:42.633895 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbe7a6-15cf-4f81-8987-ef93fcc103b7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:42.678682 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:42.686586 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465612b-0fe6-4b4d-bb47-c9174acd6db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:42.687656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465612b-0fe6-4b4d-bb47-c9174acd6db7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:42.687944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465612b-0fe6-4b4d-bb47-c9174acd6db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:42.688319 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465612b-0fe6-4b4d-bb47-c9174acd6db7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:42.694324 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 85/174] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:42.695099 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035b774-5f82-4f0f-84d3-bae3341ece33 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:42.703574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465612b-0fe6-4b4d-bb47-c9174acd6db7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-e465612b-0fe6-4b4d-bb47-c9174acd6db7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:42.710791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:42.711751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:42.712517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:42.712517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:42.712517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:42.712517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:42.712517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:42.712517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:42.712517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:42.712517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:42.712517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:42.712517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:42.712517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:42.712517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:42.712517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 90/175] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:42.713156 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465612b-0fe6-4b4d-bb47-c9174acd6db7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:42.791188 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:42.855012 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465612b-0fe6-4b4d-bb47-c9174acd6db7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:42.858915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035b774-5f82-4f0f-84d3-bae3341ece33 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:42.905011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97106ab6-4748-4e54-bae0-b5e9a9ddeb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:42.905907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97106ab6-4748-4e54-bae0-b5e9a9ddeb6a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:42.906197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97106ab6-4748-4e54-bae0-b5e9a9ddeb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:42.906480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97106ab6-4748-4e54-bae0-b5e9a9ddeb6a None admin] PATH_INFO: `/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:42.908745 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97106ab6-4748-4e54-bae0-b5e9a9ddeb6a None admin] RBAC: Authorizing `identity:get_user(user_id=bd892ec4fbfa4f31bcd7d81f7be2ea09)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:42.910256 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97106ab6-4748-4e54-bae0-b5e9a9ddeb6a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:42.914434 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f34c9-f185-43e9-95e5-5b080e0b4f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:42.915593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f34c9-f185-43e9-95e5-5b080e0b4f48 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:42.916199 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f34c9-f185-43e9-95e5-5b080e0b4f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:42.917079 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 91/176] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:42 2022] GET /identity/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:42.917425 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f34c9-f185-43e9-95e5-5b080e0b4f48 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:42.918050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97106ab6-4748-4e54-bae0-b5e9a9ddeb6a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:42.918975 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f34c9-f185-43e9-95e5-5b080e0b4f48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:42.919507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f34c9-f185-43e9-95e5-5b080e0b4f48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:42.921661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f34c9-f185-43e9-95e5-5b080e0b4f48 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:42.942108 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 86/177] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:42.944151 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430df8b4-4795-4f18-b8f3-733e858197c2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:42.944568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430df8b4-4795-4f18-b8f3-733e858197c2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:42.944720 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430df8b4-4795-4f18-b8f3-733e858197c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:42.970833 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-430df8b4-4795-4f18-b8f3-733e858197c2 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:42.972253 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-430df8b4-4795-4f18-b8f3-733e858197c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:43.062163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:43.074492 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97106ab6-4748-4e54-bae0-b5e9a9ddeb6a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:43.082720 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 87/178] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:43.082720 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430df8b4-4795-4f18-b8f3-733e858197c2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:43.108429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:43.121634 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0109ef-d425-453e-bfad-defeb3283860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:43.122758 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0109ef-d425-453e-bfad-defeb3283860 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:43.123101 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0109ef-d425-453e-bfad-defeb3283860 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:43.123391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0109ef-d425-453e-bfad-defeb3283860 None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:43.124748 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0109ef-d425-453e-bfad-defeb3283860 None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:43.126280 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0109ef-d425-453e-bfad-defeb3283860 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:43.128398 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 92/179] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:42 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:43.129376 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0109ef-d425-453e-bfad-defeb3283860 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:43.239171 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430df8b4-4795-4f18-b8f3-733e858197c2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:43.279974 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0109ef-d425-453e-bfad-defeb3283860 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:43.291094 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ddc18-240e-481c-83af-58902672888a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:43.294540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ddc18-240e-481c-83af-58902672888a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:43.294540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ddc18-240e-481c-83af-58902672888a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:43.294540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ddc18-240e-481c-83af-58902672888a None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:43.294540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ddc18-240e-481c-83af-58902672888a None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:43.294540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ddc18-240e-481c-83af-58902672888a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:43.295939 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ddc18-240e-481c-83af-58902672888a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:43.306037 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 88/180] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:30:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:43.307162 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ddc18-240e-481c-83af-58902672888a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:43.346082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebc980-7a9b-429e-8a08-df1cd5460070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:43.346940 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebc980-7a9b-429e-8a08-df1cd5460070 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:43.347225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebc980-7a9b-429e-8a08-df1cd5460070 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:43.347499 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebc980-7a9b-429e-8a08-df1cd5460070 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:43.361766 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebc980-7a9b-429e-8a08-df1cd5460070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-54ebc980-7a9b-429e-8a08-df1cd5460070 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:43.372490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:43.373667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:43.375313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:43.375313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:43.375313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:43.375313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:43.375313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:43.375313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:43.375313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:43.375313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:43.375313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:43.375313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:43.375313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:30:43.375313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:43.375313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 93/181] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:30:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:43.378344 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:43.379617 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebc980-7a9b-429e-8a08-df1cd5460070 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:43.442277 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:43.462605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ddc18-240e-481c-83af-58902672888a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:43.512835 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebc980-7a9b-429e-8a08-df1cd5460070 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:43.518808 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff8cea-9fbb-494c-9ef1-fd9ca6af3582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:43.522945 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff8cea-9fbb-494c-9ef1-fd9ca6af3582 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:43.525113 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff8cea-9fbb-494c-9ef1-fd9ca6af3582 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:43.525644 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff8cea-9fbb-494c-9ef1-fd9ca6af3582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:43.574888 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0c955-911f-4184-a03c-dc31c477e943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:43.575794 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0c955-911f-4184-a03c-dc31c477e943 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:43.576077 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0c955-911f-4184-a03c-dc31c477e943 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:43.576728 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0c955-911f-4184-a03c-dc31c477e943 None admin] PATH_INFO: `/v3/users/5c0884f4e93a4fdd9a5aaf8e13258e8c` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:43.598511 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0c955-911f-4184-a03c-dc31c477e943 None admin] RBAC: Authorizing `identity:get_user(user_id=5c0884f4e93a4fdd9a5aaf8e13258e8c)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:43.600689 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0c955-911f-4184-a03c-dc31c477e943 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:43.603513 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 94/182] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:43 2022] GET /identity/v3/users/5c0884f4e93a4fdd9a5aaf8e13258e8c => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:43.609313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0c955-911f-4184-a03c-dc31c477e943 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:43.671764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff8cea-9fbb-494c-9ef1-fd9ca6af3582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:43.674081 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff8cea-9fbb-494c-9ef1-fd9ca6af3582 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:43.730075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:43.760096 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0c955-911f-4184-a03c-dc31c477e943 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:43.779728 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:43.792207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 89/183] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:30:43.793488 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff8cea-9fbb-494c-9ef1-fd9ca6af3582 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:43.812365 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe810c2f-acc8-49ad-8e20-7c8f94249d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:43.813707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe810c2f-acc8-49ad-8e20-7c8f94249d35 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:43.813996 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe810c2f-acc8-49ad-8e20-7c8f94249d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:43.814272 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe810c2f-acc8-49ad-8e20-7c8f94249d35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:43.816217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe810c2f-acc8-49ad-8e20-7c8f94249d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:43.819166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe810c2f-acc8-49ad-8e20-7c8f94249d35 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:43.822445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 95/184] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:30:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:43.823757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe810c2f-acc8-49ad-8e20-7c8f94249d35 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:43.923852 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff8cea-9fbb-494c-9ef1-fd9ca6af3582 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:43.967364 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe810c2f-acc8-49ad-8e20-7c8f94249d35 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:43.977094 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa365f4-eec4-485b-af3e-5bdf8711fc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:43.978340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa365f4-eec4-485b-af3e-5bdf8711fc71 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:43.978946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa365f4-eec4-485b-af3e-5bdf8711fc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:43.979434 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa365f4-eec4-485b-af3e-5bdf8711fc71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:43.981012 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa365f4-eec4-485b-af3e-5bdf8711fc71 None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=50c4a61b8f494e029afaea135bfd4777, user.id=99cee851d5f84c3782ff1a60b5667a3d) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:43.981584 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa365f4-eec4-485b-af3e-5bdf8711fc71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:43.984345 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa365f4-eec4-485b-af3e-5bdf8711fc71 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:44.002547 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 90/185] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:43 2022] GET /identity/v3/role_assignments?user.id=99cee851d5f84c3782ff1a60b5667a3d&scope.project.id=50c4a61b8f494e029afaea135bfd4777&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:44.002547 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa365f4-eec4-485b-af3e-5bdf8711fc71 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:44.015213 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:44.021941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bc087-d8da-474c-a045-f83a103a4d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:44.023566 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bc087-d8da-474c-a045-f83a103a4d41 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:44.023692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bc087-d8da-474c-a045-f83a103a4d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:44.023896 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bc087-d8da-474c-a045-f83a103a4d41 None admin] PATH_INFO: `/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:44.026433 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bc087-d8da-474c-a045-f83a103a4d41 None admin] RBAC: Authorizing `identity:get_user(user_id=bd892ec4fbfa4f31bcd7d81f7be2ea09)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:44.029091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bc087-d8da-474c-a045-f83a103a4d41 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:44.031402 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 96/186] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:43 2022] GET /identity/v3/users/bd892ec4fbfa4f31bcd7d81f7be2ea09 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:44.032952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bc087-d8da-474c-a045-f83a103a4d41 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:44.119841 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:44.175507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa365f4-eec4-485b-af3e-5bdf8711fc71 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:44.212175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bc087-d8da-474c-a045-f83a103a4d41 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:44.231196 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1e088-093f-4b1e-a5ea-4388fb4a5bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:44.232556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1e088-093f-4b1e-a5ea-4388fb4a5bda None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:44.233197 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1e088-093f-4b1e-a5ea-4388fb4a5bda None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:44.233650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1e088-093f-4b1e-a5ea-4388fb4a5bda None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:44.235450 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1e088-093f-4b1e-a5ea-4388fb4a5bda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:44.236205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1e088-093f-4b1e-a5ea-4388fb4a5bda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:44.242837 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1e088-093f-4b1e-a5ea-4388fb4a5bda None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:44.256262 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 91/187] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:30:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:44.259579 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04e0c6-e885-4349-b29a-de77132b2716 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:44.260419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04e0c6-e885-4349-b29a-de77132b2716 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:44.261532 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04e0c6-e885-4349-b29a-de77132b2716 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:44.264165 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 92/188] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:44.265386 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04e0c6-e885-4349-b29a-de77132b2716 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:44.285298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803dce-c311-4392-9b82-f6a0cd7de2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:44.285975 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803dce-c311-4392-9b82-f6a0cd7de2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:44.286269 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803dce-c311-4392-9b82-f6a0cd7de2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:44.286579 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803dce-c311-4392-9b82-f6a0cd7de2e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:44.361220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:44.377975 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82803dce-c311-4392-9b82-f6a0cd7de2e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:44.380771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82803dce-c311-4392-9b82-f6a0cd7de2e2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:44.390100 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04e0c6-e885-4349-b29a-de77132b2716 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:44.440713 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe92c38-117d-47de-8818-437a5e36666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:44.442079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe92c38-117d-47de-8818-437a5e36666d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:44.442628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe92c38-117d-47de-8818-437a5e36666d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:44.443073 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe92c38-117d-47de-8818-437a5e36666d None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:44.444092 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:44.445093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe92c38-117d-47de-8818-437a5e36666d None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:44.448351 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe92c38-117d-47de-8818-437a5e36666d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:44.452179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 93/189] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:44 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:44.453669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe92c38-117d-47de-8818-437a5e36666d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:44.522162 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 97/190] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:30:44.523392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803dce-c311-4392-9b82-f6a0cd7de2e2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:44.597773 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe92c38-117d-47de-8818-437a5e36666d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:44.659581 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6eef53-cd79-40f4-9f3d-698fa308926c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:44.660713 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eef53-cd79-40f4-9f3d-698fa308926c None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:44.661190 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eef53-cd79-40f4-9f3d-698fa308926c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:44.661640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eef53-cd79-40f4-9f3d-698fa308926c None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:44.662839 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6eef53-cd79-40f4-9f3d-698fa308926c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:44.664284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803dce-c311-4392-9b82-f6a0cd7de2e2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:44.665325 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6eef53-cd79-40f4-9f3d-698fa308926c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:44.691157 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:44.710530 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 94/191] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:30:44 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:30:44.710530 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6eef53-cd79-40f4-9f3d-698fa308926c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:44.724692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4175d-26d5-4443-a1e7-a7e80fd8e6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:44.725722 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4175d-26d5-4443-a1e7-a7e80fd8e6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:44.726024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4175d-26d5-4443-a1e7-a7e80fd8e6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:44.726314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4175d-26d5-4443-a1e7-a7e80fd8e6f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:44.748006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:44.824893 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4175d-26d5-4443-a1e7-a7e80fd8e6f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:44.826428 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4175d-26d5-4443-a1e7-a7e80fd8e6f7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:44.927241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6eef53-cd79-40f4-9f3d-698fa308926c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:44.987874 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2b3e1-5319-4645-8299-67945df2ef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:44.989658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2b3e1-5319-4645-8299-67945df2ef55 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:44.989951 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2b3e1-5319-4645-8299-67945df2ef55 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:44.990343 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2b3e1-5319-4645-8299-67945df2ef55 None admin] PATH_INFO: `/v3/users/5c0884f4e93a4fdd9a5aaf8e13258e8c` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:44.993345 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2b3e1-5319-4645-8299-67945df2ef55 None admin] RBAC: Authorizing `identity:get_user(user_id=5c0884f4e93a4fdd9a5aaf8e13258e8c)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:44.994875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2b3e1-5319-4645-8299-67945df2ef55 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:44.996871 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 95/192] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:44 2022] GET /identity/v3/users/5c0884f4e93a4fdd9a5aaf8e13258e8c => generated 283 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:44.997917 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ea64-c78f-4126-81ef-d59f9cdf92bf None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:44.998317 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ea64-c78f-4126-81ef-d59f9cdf92bf None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:44.998475 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ea64-c78f-4126-81ef-d59f9cdf92bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:45.014979 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 98/193] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:30:45.015474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4175d-26d5-4443-a1e7-a7e80fd8e6f7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:45.032277 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dc98ea64-c78f-4126-81ef-d59f9cdf92bf None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:45.033510 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dc98ea64-c78f-4126-81ef-d59f9cdf92bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:45.108899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:45.189331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4175d-26d5-4443-a1e7-a7e80fd8e6f7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:45.215770 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:45.226180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 96/194] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:45.226910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ea64-c78f-4126-81ef-d59f9cdf92bf None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:45.249373 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c2082-77ff-42c2-930c-39476ab2949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:45.250071 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c2082-77ff-42c2-930c-39476ab2949f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:45.250395 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c2082-77ff-42c2-930c-39476ab2949f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:45.250709 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c2082-77ff-42c2-930c-39476ab2949f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:45.251572 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c2082-77ff-42c2-930c-39476ab2949f None admin] RBAC: Adding query filter params (role.id=f0b3744c39ca4eb7b78ef642c0175a0a, scope.project.id=50c4a61b8f494e029afaea135bfd4777, user.id=bd892ec4fbfa4f31bcd7d81f7be2ea09) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:45.251890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c2082-77ff-42c2-930c-39476ab2949f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:45.253383 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c2082-77ff-42c2-930c-39476ab2949f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:45.267696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 99/195] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:45 2022] GET /identity/v3/role_assignments?user.id=bd892ec4fbfa4f31bcd7d81f7be2ea09&scope.project.id=50c4a61b8f494e029afaea135bfd4777&role.id=f0b3744c39ca4eb7b78ef642c0175a0a => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:45.268968 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c2082-77ff-42c2-930c-39476ab2949f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:45.574274 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c2082-77ff-42c2-930c-39476ab2949f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:45.578965 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ea64-c78f-4126-81ef-d59f9cdf92bf None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:45.585094 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:45.630523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249dce5-f0fe-4a86-b9de-442157a42469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:45.630523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249dce5-f0fe-4a86-b9de-442157a42469 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:45.630523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249dce5-f0fe-4a86-b9de-442157a42469 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:45.630523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249dce5-f0fe-4a86-b9de-442157a42469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:45.690524 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd1c34-2370-4a10-830d-fda6e81d0dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:45.690524 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd1c34-2370-4a10-830d-fda6e81d0dbe None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:45.690524 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd1c34-2370-4a10-830d-fda6e81d0dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:45.690524 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd1c34-2370-4a10-830d-fda6e81d0dbe None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:45.694542 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd1c34-2370-4a10-830d-fda6e81d0dbe None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:45.694542 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd1c34-2370-4a10-830d-fda6e81d0dbe None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:45.701273 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 97/196] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:45 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:45.701273 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd1c34-2370-4a10-830d-fda6e81d0dbe None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:45.797985 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249dce5-f0fe-4a86-b9de-442157a42469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:45.802536 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249dce5-f0fe-4a86-b9de-442157a42469 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:45.864774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:45.944675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd1c34-2370-4a10-830d-fda6e81d0dbe None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:46.016559 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db2c39-0663-4afd-bbfc-f39317713582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:46.018338 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db2c39-0663-4afd-bbfc-f39317713582 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:46.019144 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db2c39-0663-4afd-bbfc-f39317713582 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:46.019625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db2c39-0663-4afd-bbfc-f39317713582 None admin] PATH_INFO: `/v3/projects/00474714affc48678578060800edd2ae` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:46.021622 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db2c39-0663-4afd-bbfc-f39317713582 None admin] RBAC: Authorizing `identity:get_project(project_id=00474714affc48678578060800edd2ae)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:46.023841 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db2c39-0663-4afd-bbfc-f39317713582 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:46.029723 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 98/198] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:45 2022] GET /identity/v3/projects/00474714affc48678578060800edd2ae => generated 312 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:46.029900 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 100/198] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:30:46.030882 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249dce5-f0fe-4a86-b9de-442157a42469 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:46.031257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db2c39-0663-4afd-bbfc-f39317713582 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:46.044937 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:46.151255 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249dce5-f0fe-4a86-b9de-442157a42469 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:46.176392 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db2c39-0663-4afd-bbfc-f39317713582 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:46.192332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be37bd-5337-43ef-9ab8-48430abcd458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:46.193143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be37bd-5337-43ef-9ab8-48430abcd458 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:46.193427 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be37bd-5337-43ef-9ab8-48430abcd458 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:46.193704 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be37bd-5337-43ef-9ab8-48430abcd458 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:46.206196 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be37bd-5337-43ef-9ab8-48430abcd458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-64be37bd-5337-43ef-9ab8-48430abcd458 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:46.214183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:46.215180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:46.216417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:46.216417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:46.216417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:46.216417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:46.216417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:46.216417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:46.216417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:46.216417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:46.216417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:46.216417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:46.216417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:30:46.216417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:46.216417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 101/199] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:46.216417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be37bd-5337-43ef-9ab8-48430abcd458 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:46.221495 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4062a-dc9a-46d0-a641-b983db9c835a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:46.222586 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4062a-dc9a-46d0-a641-b983db9c835a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:46.223074 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4062a-dc9a-46d0-a641-b983db9c835a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:46.223546 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4062a-dc9a-46d0-a641-b983db9c835a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:46.224691 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4062a-dc9a-46d0-a641-b983db9c835a None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=553fd0a11f484754beb16edeccbddc21, user.id=5c0884f4e93a4fdd9a5aaf8e13258e8c) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:46.225249 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4062a-dc9a-46d0-a641-b983db9c835a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:46.227036 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4062a-dc9a-46d0-a641-b983db9c835a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:46.229354 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:46.235720 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 99/200] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:46 2022] GET /identity/v3/role_assignments?user.id=5c0884f4e93a4fdd9a5aaf8e13258e8c&scope.project.id=553fd0a11f484754beb16edeccbddc21&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:46.237104 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4062a-dc9a-46d0-a641-b983db9c835a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:46.362332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:46.404755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4062a-dc9a-46d0-a641-b983db9c835a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:46.447109 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be37bd-5337-43ef-9ab8-48430abcd458 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:46.451757 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f62af-a5eb-4a55-8af1-092deec0f987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:46.452779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f62af-a5eb-4a55-8af1-092deec0f987 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:46.454790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f62af-a5eb-4a55-8af1-092deec0f987 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:46.455380 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f62af-a5eb-4a55-8af1-092deec0f987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:46.456545 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f62af-a5eb-4a55-8af1-092deec0f987 None admin] RBAC: Adding query filter params (role.id=edcc1e17fab74f2d93941e3c37b66546, scope.project.id=00474714affc48678578060800edd2ae, user.id=bd892ec4fbfa4f31bcd7d81f7be2ea09) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:46.457460 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f62af-a5eb-4a55-8af1-092deec0f987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:46.459272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f62af-a5eb-4a55-8af1-092deec0f987 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:46.474688 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 100/201] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:46 2022] GET /identity/v3/role_assignments?user.id=bd892ec4fbfa4f31bcd7d81f7be2ea09&scope.project.id=00474714affc48678578060800edd2ae&role.id=edcc1e17fab74f2d93941e3c37b66546 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:46.476316 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f62af-a5eb-4a55-8af1-092deec0f987 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:46.540902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f368b-541c-47f3-b19d-a68114c259db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:46.542262 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f368b-541c-47f3-b19d-a68114c259db None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:46.542777 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f368b-541c-47f3-b19d-a68114c259db None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:46.545740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f368b-541c-47f3-b19d-a68114c259db None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:46.547575 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f368b-541c-47f3-b19d-a68114c259db None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:46.549342 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f368b-541c-47f3-b19d-a68114c259db None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:46.558590 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 102/202] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:46 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:46.564841 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f368b-541c-47f3-b19d-a68114c259db None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:46.614739 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:46.712703 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f62af-a5eb-4a55-8af1-092deec0f987 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:46.760849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccf8ec-fb31-4fa2-8d7a-38283ec48e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:46.761547 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccf8ec-fb31-4fa2-8d7a-38283ec48e47 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:46.761838 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccf8ec-fb31-4fa2-8d7a-38283ec48e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:46.762106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccf8ec-fb31-4fa2-8d7a-38283ec48e47 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:46.763053 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccf8ec-fb31-4fa2-8d7a-38283ec48e47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:46.763376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccf8ec-fb31-4fa2-8d7a-38283ec48e47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:46.764853 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccf8ec-fb31-4fa2-8d7a-38283ec48e47 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:46.775897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 101/203] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:30:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:46.781374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccf8ec-fb31-4fa2-8d7a-38283ec48e47 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:46.908388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f368b-541c-47f3-b19d-a68114c259db None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:46.949633 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88323ad-4807-4d3e-a49a-b6763b3a0a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:46.950308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88323ad-4807-4d3e-a49a-b6763b3a0a68 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:46.950618 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88323ad-4807-4d3e-a49a-b6763b3a0a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:46.950900 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88323ad-4807-4d3e-a49a-b6763b3a0a68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:46.952194 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88323ad-4807-4d3e-a49a-b6763b3a0a68 None admin] RBAC: Adding query filter params (role.id=f0b3744c39ca4eb7b78ef642c0175a0a, scope.project.id=553fd0a11f484754beb16edeccbddc21, user.id=5c0884f4e93a4fdd9a5aaf8e13258e8c) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:46.952518 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88323ad-4807-4d3e-a49a-b6763b3a0a68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:46.954591 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88323ad-4807-4d3e-a49a-b6763b3a0a68 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:46.954856 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccf8ec-fb31-4fa2-8d7a-38283ec48e47 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:46.961395 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 103/204] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:46 2022] GET /identity/v3/role_assignments?user.id=5c0884f4e93a4fdd9a5aaf8e13258e8c&scope.project.id=553fd0a11f484754beb16edeccbddc21&role.id=f0b3744c39ca4eb7b78ef642c0175a0a => generated 259 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:46.961998 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:47.019856 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:47.041932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a9623-e1ce-4204-a4c6-03a22535e696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:47.043278 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a9623-e1ce-4204-a4c6-03a22535e696 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:47.043814 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a9623-e1ce-4204-a4c6-03a22535e696 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:47.044300 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a9623-e1ce-4204-a4c6-03a22535e696 None admin] PATH_INFO: `/v3/users/b2d8a96f1c6d468dbd3633d2c68d6bfa` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:47.047558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a9623-e1ce-4204-a4c6-03a22535e696 None admin] RBAC: Authorizing `identity:get_user(user_id=b2d8a96f1c6d468dbd3633d2c68d6bfa)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:47.049417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a9623-e1ce-4204-a4c6-03a22535e696 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:47.052731 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 102/205] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:46 2022] GET /identity/v3/users/b2d8a96f1c6d468dbd3633d2c68d6bfa => generated 289 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:47.059228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88323ad-4807-4d3e-a49a-b6763b3a0a68 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:47.265443 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88323ad-4807-4d3e-a49a-b6763b3a0a68 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:47.338079 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36067b8b-05fa-4635-8af1-94c5d7565135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:47.339191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36067b8b-05fa-4635-8af1-94c5d7565135 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:47.339699 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36067b8b-05fa-4635-8af1-94c5d7565135 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:47.340219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36067b8b-05fa-4635-8af1-94c5d7565135 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:47.392467 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d5e9a-4b21-4fa9-a6f6-dc47ff78ea69 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:47.393099 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d5e9a-4b21-4fa9-a6f6-dc47ff78ea69 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:47.393604 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d5e9a-4b21-4fa9-a6f6-dc47ff78ea69 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:47.395327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 103/206] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:30:47.404317 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922d0c2-f694-4e06-a5b8-658c7e9579a9 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:47.404915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922d0c2-f694-4e06-a5b8-658c7e9579a9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:47.405395 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922d0c2-f694-4e06-a5b8-658c7e9579a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:47.435567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4922d0c2-f694-4e06-a5b8-658c7e9579a9 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:47.437156 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4922d0c2-f694-4e06-a5b8-658c7e9579a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:47.480991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:47.488857 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36067b8b-05fa-4635-8af1-94c5d7565135 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:47.490696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36067b8b-05fa-4635-8af1-94c5d7565135 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:47.610949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 104/207] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:30:47.643672 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922d0c2-f694-4e06-a5b8-658c7e9579a9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:47.692900 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 104/208] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:30:47.701001 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36067b8b-05fa-4635-8af1-94c5d7565135 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:47.915785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922d0c2-f694-4e06-a5b8-658c7e9579a9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:47.941552 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:47.956992 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b677563-b8b9-47c0-ba16-6c370bc20c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:47.958803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b677563-b8b9-47c0-ba16-6c370bc20c5d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:47.959240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b677563-b8b9-47c0-ba16-6c370bc20c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:47.959663 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b677563-b8b9-47c0-ba16-6c370bc20c5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:47.961044 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b677563-b8b9-47c0-ba16-6c370bc20c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:47.962677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b677563-b8b9-47c0-ba16-6c370bc20c5d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:47.965442 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 105/209] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:30:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:47.971569 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b677563-b8b9-47c0-ba16-6c370bc20c5d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:48.084300 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b677563-b8b9-47c0-ba16-6c370bc20c5d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:48.095007 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:48.100750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36067b8b-05fa-4635-8af1-94c5d7565135 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:48.125859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5c81-7172-4cb1-80b9-5e79ec0ebb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:48.126910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5c81-7172-4cb1-80b9-5e79ec0ebb22 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:48.127352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5c81-7172-4cb1-80b9-5e79ec0ebb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:48.127786 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5c81-7172-4cb1-80b9-5e79ec0ebb22 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:48.128649 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc5c81-7172-4cb1-80b9-5e79ec0ebb22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:48.130261 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc5c81-7172-4cb1-80b9-5e79ec0ebb22 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:48.157237 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 106/210] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:30:47 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:30:48.212995 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357edf1-d3fe-4204-9ffc-ddc03fc0f45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:48.213809 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357edf1-d3fe-4204-9ffc-ddc03fc0f45f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:48.214094 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357edf1-d3fe-4204-9ffc-ddc03fc0f45f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:48.214374 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357edf1-d3fe-4204-9ffc-ddc03fc0f45f None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:48.219727 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357edf1-d3fe-4204-9ffc-ddc03fc0f45f None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:48.221265 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357edf1-d3fe-4204-9ffc-ddc03fc0f45f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:48.223188 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 105/211] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:47 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:48.233014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5c81-7172-4cb1-80b9-5e79ec0ebb22 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:48.318117 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:48.379821 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5c81-7172-4cb1-80b9-5e79ec0ebb22 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:48.419401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5be2e-ac01-49ba-908e-20b1d172311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:48.420420 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5be2e-ac01-49ba-908e-20b1d172311e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:48.420893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5be2e-ac01-49ba-908e-20b1d172311e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:48.421385 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5be2e-ac01-49ba-908e-20b1d172311e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:48.422489 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5be2e-ac01-49ba-908e-20b1d172311e None admin] RBAC: Adding query filter params (role.id=50aac635500847d795e12adf460cbe94, scope.project.id=50c4a61b8f494e029afaea135bfd4777, user.id=b2d8a96f1c6d468dbd3633d2c68d6bfa) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:48.423067 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5be2e-ac01-49ba-908e-20b1d172311e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:48.424763 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5be2e-ac01-49ba-908e-20b1d172311e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:48.432297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 107/212] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:48 2022] GET /identity/v3/role_assignments?user.id=b2d8a96f1c6d468dbd3633d2c68d6bfa&scope.project.id=50c4a61b8f494e029afaea135bfd4777&role.id=50aac635500847d795e12adf460cbe94 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:48.641971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb588eb-41ab-42ed-9559-e1b8c61fc648 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:48.642286 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb588eb-41ab-42ed-9559-e1b8c61fc648 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:48.642624 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb588eb-41ab-42ed-9559-e1b8c61fc648 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:48.644016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 106/213] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:30:48.650936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5651b2c-2192-4ffd-840b-76427068625b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:48.651579 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5651b2c-2192-4ffd-840b-76427068625b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:48.652053 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5651b2c-2192-4ffd-840b-76427068625b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:48.670907 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f5651b2c-2192-4ffd-840b-76427068625b None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:48.673132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f5651b2c-2192-4ffd-840b-76427068625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:48.758416 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 108/214] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:48.782836 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb588eb-41ab-42ed-9559-e1b8c61fc648 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:48.916838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb588eb-41ab-42ed-9559-e1b8c61fc648 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:48.966803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dfd09-b9b4-40d4-983b-0d95fb925e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:48.967995 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dfd09-b9b4-40d4-983b-0d95fb925e28 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:48.968483 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dfd09-b9b4-40d4-983b-0d95fb925e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:48.969513 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dfd09-b9b4-40d4-983b-0d95fb925e28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:48.985393 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dfd09-b9b4-40d4-983b-0d95fb925e28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-889dfd09-b9b4-40d4-983b-0d95fb925e28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:48.993984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:48.994967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:48.995740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:48.995740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:48.995740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:48.995740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:48.995740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:48.995740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:48.995740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:48.995740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:48.995740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:48.995740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:48.995740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:48.995740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:48.996329 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 107/215] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:49.003377 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5651b2c-2192-4ffd-840b-76427068625b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:49.100544 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:49.164147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f64ab7-6509-459e-823e-8c2104cc4d4c None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:49.164652 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f64ab7-6509-459e-823e-8c2104cc4d4c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:49.164726 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f64ab7-6509-459e-823e-8c2104cc4d4c None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:49.166298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 108/216] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:30:49.172405 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8e56b-89f6-4e85-aab8-f8003c712027 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:49.172666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8e56b-89f6-4e85-aab8-f8003c712027 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:49.172908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8e56b-89f6-4e85-aab8-f8003c712027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:49.208961 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-34b8e56b-89f6-4e85-aab8-f8003c712027 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:49.210202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-34b8e56b-89f6-4e85-aab8-f8003c712027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:49.228103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5651b2c-2192-4ffd-840b-76427068625b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:49.288529 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:49.335145 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f527fe-6627-41a5-9ff7-45dfe4835372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:49.336682 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f527fe-6627-41a5-9ff7-45dfe4835372 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:49.336682 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f527fe-6627-41a5-9ff7-45dfe4835372 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:49.337025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f527fe-6627-41a5-9ff7-45dfe4835372 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:49.337838 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f527fe-6627-41a5-9ff7-45dfe4835372 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:49.338257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f527fe-6627-41a5-9ff7-45dfe4835372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:49.348659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f527fe-6627-41a5-9ff7-45dfe4835372 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:49.359796 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 109/217] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:30:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:49.365321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f527fe-6627-41a5-9ff7-45dfe4835372 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:49.388234 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 109/218] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:49.419575 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8e56b-89f6-4e85-aab8-f8003c712027 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:49.673333 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f527fe-6627-41a5-9ff7-45dfe4835372 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:49.683382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:49.731631 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8e56b-89f6-4e85-aab8-f8003c712027 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:49.776208 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c5d3c-ddc5-46df-9a6c-e1b0dcf338d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:49.777232 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c5d3c-ddc5-46df-9a6c-e1b0dcf338d9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:49.777536 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c5d3c-ddc5-46df-9a6c-e1b0dcf338d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:49.778265 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c5d3c-ddc5-46df-9a6c-e1b0dcf338d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:49.791308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76ad07-ac72-4d2b-9f2b-3aa781e3992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:49.791586 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c5d3c-ddc5-46df-9a6c-e1b0dcf338d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:49.793124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76ad07-ac72-4d2b-9f2b-3aa781e3992c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:49.793867 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76ad07-ac72-4d2b-9f2b-3aa781e3992c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:49.794482 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76ad07-ac72-4d2b-9f2b-3aa781e3992c None admin] PATH_INFO: `/v3/users/b055fec304d64b4d8f980a8f66760ef2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-6c9c5d3c-ddc5-46df-9a6c-e1b0dcf338d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:49.802885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:49.804859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:49.806736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:49.806736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:49.806736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:49.806736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:49.806736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:49.806736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:49.806736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:49.806736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:49.806736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:49.806736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:49.806736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:49.806736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:49.806736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 110/219] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:30:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:30:49.806736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdcf9f-fb52-4194-8838-74db74351599 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:49.808970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdcf9f-fb52-4194-8838-74db74351599 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:49.808970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdcf9f-fb52-4194-8838-74db74351599 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:49.808970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 111/220] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:49.818551 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5cb1a-8b31-45d2-bc4b-b23f4295fcbb None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:49.818551 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5cb1a-8b31-45d2-bc4b-b23f4295fcbb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:49.818551 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5cb1a-8b31-45d2-bc4b-b23f4295fcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:49.825275 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76ad07-ac72-4d2b-9f2b-3aa781e3992c None admin] RBAC: Authorizing `identity:get_user(user_id=b055fec304d64b4d8f980a8f66760ef2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:49.829007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76ad07-ac72-4d2b-9f2b-3aa781e3992c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:49.833017 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 110/221] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:49 2022] GET /identity/v3/users/b055fec304d64b4d8f980a8f66760ef2 => generated 297 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:49.834719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76ad07-ac72-4d2b-9f2b-3aa781e3992c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:49.835561 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f4a5cb1a-8b31-45d2-bc4b-b23f4295fcbb None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:49.836828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f4a5cb1a-8b31-45d2-bc4b-b23f4295fcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:49.854682 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:49.926356 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 112/222] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:30:49.927273 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5cb1a-8b31-45d2-bc4b-b23f4295fcbb None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:50.011670 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76ad07-ac72-4d2b-9f2b-3aa781e3992c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:50.056640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be5042-b562-4a75-8110-79de55fd478c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:50.057582 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be5042-b562-4a75-8110-79de55fd478c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:50.058219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be5042-b562-4a75-8110-79de55fd478c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:50.058672 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be5042-b562-4a75-8110-79de55fd478c None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:50.060508 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be5042-b562-4a75-8110-79de55fd478c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:50.061005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be5042-b562-4a75-8110-79de55fd478c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:50.063289 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be5042-b562-4a75-8110-79de55fd478c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:50.073956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 111/223] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:50.075092 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be5042-b562-4a75-8110-79de55fd478c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:50.107392 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:50.129335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5cb1a-8b31-45d2-bc4b-b23f4295fcbb None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:50.204350 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d114c28-db5b-4bdd-896b-21327ec72d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:50.206468 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d114c28-db5b-4bdd-896b-21327ec72d1d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:50.207171 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d114c28-db5b-4bdd-896b-21327ec72d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:50.207853 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d114c28-db5b-4bdd-896b-21327ec72d1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:50.243333 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:50.261060 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be5042-b562-4a75-8110-79de55fd478c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:50.314448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902279a7-4882-47bc-8b01-237e9bc28140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:50.315525 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902279a7-4882-47bc-8b01-237e9bc28140 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:50.316561 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902279a7-4882-47bc-8b01-237e9bc28140 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:50.316990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902279a7-4882-47bc-8b01-237e9bc28140 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:50.331437 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902279a7-4882-47bc-8b01-237e9bc28140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-902279a7-4882-47bc-8b01-237e9bc28140 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:50.341578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:50.342647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:50.343548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:50.343548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:50.343548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:50.343548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:50.343548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:50.343548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:50.343548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:50.343548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:50.343548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:50.343548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:50.343548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:30:50.343548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:30:50.345944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d114c28-db5b-4bdd-896b-21327ec72d1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:50.346284 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 112/224] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:30:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:50.347346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902279a7-4882-47bc-8b01-237e9bc28140 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:50.349360 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d114c28-db5b-4bdd-896b-21327ec72d1d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:50.471503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:50.496181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 113/225] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:30:50.497322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d114c28-db5b-4bdd-896b-21327ec72d1d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:50.509064 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902279a7-4882-47bc-8b01-237e9bc28140 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:50.551044 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8761d28-dc9e-4adf-831c-3a9046ee1324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:50.552144 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8761d28-dc9e-4adf-831c-3a9046ee1324 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:50.552765 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8761d28-dc9e-4adf-831c-3a9046ee1324 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:50.552765 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8761d28-dc9e-4adf-831c-3a9046ee1324 None admin] PATH_INFO: `/v3/users/5c0884f4e93a4fdd9a5aaf8e13258e8c` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:50.554163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8761d28-dc9e-4adf-831c-3a9046ee1324 None admin] RBAC: Authorizing `identity:get_user(user_id=5c0884f4e93a4fdd9a5aaf8e13258e8c)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:50.555864 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8761d28-dc9e-4adf-831c-3a9046ee1324 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:50.557710 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 113/226] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:50 2022] GET /identity/v3/users/5c0884f4e93a4fdd9a5aaf8e13258e8c => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:50.563112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8761d28-dc9e-4adf-831c-3a9046ee1324 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:50.599409 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:50.670675 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d114c28-db5b-4bdd-896b-21327ec72d1d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:50.676572 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8761d28-dc9e-4adf-831c-3a9046ee1324 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:50.710075 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f087a15-2c90-439e-94a1-2f94394962d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:50.710786 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f087a15-2c90-439e-94a1-2f94394962d0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:50.711070 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f087a15-2c90-439e-94a1-2f94394962d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:50.711347 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f087a15-2c90-439e-94a1-2f94394962d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:50.712110 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f087a15-2c90-439e-94a1-2f94394962d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:50.712421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f087a15-2c90-439e-94a1-2f94394962d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:50.713807 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f087a15-2c90-439e-94a1-2f94394962d0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:50.714821 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ecd98-0bf2-42d4-bba7-7b69f87c4506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:50.715710 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ecd98-0bf2-42d4-bba7-7b69f87c4506 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:50.715999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ecd98-0bf2-42d4-bba7-7b69f87c4506 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:50.716281 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ecd98-0bf2-42d4-bba7-7b69f87c4506 None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:50.717577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ecd98-0bf2-42d4-bba7-7b69f87c4506 None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:50.719632 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ecd98-0bf2-42d4-bba7-7b69f87c4506 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:50.723740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 114/228] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:30:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:50.724597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f087a15-2c90-439e-94a1-2f94394962d0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:50.726570 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 114/228] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:50 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:50.732276 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ecd98-0bf2-42d4-bba7-7b69f87c4506 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:50.773619 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:50.843604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f087a15-2c90-439e-94a1-2f94394962d0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:50.856304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:50.883238 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4bd98-2007-445b-8746-7c9f0c33eee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:50.884496 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4bd98-2007-445b-8746-7c9f0c33eee0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:50.884967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4bd98-2007-445b-8746-7c9f0c33eee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:50.885389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4bd98-2007-445b-8746-7c9f0c33eee0 None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:50.887090 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4bd98-2007-445b-8746-7c9f0c33eee0 None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:50.888808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4bd98-2007-445b-8746-7c9f0c33eee0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:50.891765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 115/229] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:50 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:50.892836 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4bd98-2007-445b-8746-7c9f0c33eee0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:50.898605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ecd98-0bf2-42d4-bba7-7b69f87c4506 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:50.937443 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8d478-b236-4ef8-8754-027eb653df0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:50.938601 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8d478-b236-4ef8-8754-027eb653df0a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:50.938601 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8d478-b236-4ef8-8754-027eb653df0a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:50.938789 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8d478-b236-4ef8-8754-027eb653df0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:50.939642 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8d478-b236-4ef8-8754-027eb653df0a None admin] RBAC: Adding query filter params (role.id=edcc1e17fab74f2d93941e3c37b66546, scope.project.id=553fd0a11f484754beb16edeccbddc21, user.id=b055fec304d64b4d8f980a8f66760ef2) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:50.939973 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8d478-b236-4ef8-8754-027eb653df0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:50.941556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8d478-b236-4ef8-8754-027eb653df0a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:50.955065 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 115/230] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:50 2022] GET /identity/v3/role_assignments?user.id=b055fec304d64b4d8f980a8f66760ef2&scope.project.id=553fd0a11f484754beb16edeccbddc21&role.id=edcc1e17fab74f2d93941e3c37b66546 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:50.956158 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8d478-b236-4ef8-8754-027eb653df0a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:51.010115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4bd98-2007-445b-8746-7c9f0c33eee0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:51.051425 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26311c05-ced7-4d6a-a99b-940e8a99dd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:51.052559 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26311c05-ced7-4d6a-a99b-940e8a99dd35 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:51.052986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26311c05-ced7-4d6a-a99b-940e8a99dd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:51.053457 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26311c05-ced7-4d6a-a99b-940e8a99dd35 None admin] PATH_INFO: `/v3/users/5c0884f4e93a4fdd9a5aaf8e13258e8c` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:51.055081 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26311c05-ced7-4d6a-a99b-940e8a99dd35 None admin] RBAC: Authorizing `identity:get_user(user_id=5c0884f4e93a4fdd9a5aaf8e13258e8c)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:51.056759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26311c05-ced7-4d6a-a99b-940e8a99dd35 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:51.059130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 116/231] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:50 2022] GET /identity/v3/users/5c0884f4e93a4fdd9a5aaf8e13258e8c => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:51.065027 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26311c05-ced7-4d6a-a99b-940e8a99dd35 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:51.120998 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:51.122253 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:51.163458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8d478-b236-4ef8-8754-027eb653df0a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:51.186234 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26311c05-ced7-4d6a-a99b-940e8a99dd35 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:51.229811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8ee79-1bfb-4a20-912a-8007f09e5a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:51.230991 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8ee79-1bfb-4a20-912a-8007f09e5a2f None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:51.231285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8ee79-1bfb-4a20-912a-8007f09e5a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:51.231576 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8ee79-1bfb-4a20-912a-8007f09e5a2f None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21/users/5c0884f4e93a4fdd9a5aaf8e13258e8c/roles/efaf387c51e14931820f2a9b33ac5175` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:51.233697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686f2f-dbbd-43f4-a694-7a5b2b0288b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:51.234220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8ee79-1bfb-4a20-912a-8007f09e5a2f None admin] RBAC: Authorizing `identity:create_grant(project_id=553fd0a11f484754beb16edeccbddc21, user_id=5c0884f4e93a4fdd9a5aaf8e13258e8c, role_id=efaf387c51e14931820f2a9b33ac5175)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:51.235283 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686f2f-dbbd-43f4-a694-7a5b2b0288b2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:51.235498 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8ee79-1bfb-4a20-912a-8007f09e5a2f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:51.235905 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686f2f-dbbd-43f4-a694-7a5b2b0288b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:51.236323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a686f2f-dbbd-43f4-a694-7a5b2b0288b2 None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:51.237938 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a686f2f-dbbd-43f4-a694-7a5b2b0288b2 None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:51.239632 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a686f2f-dbbd-43f4-a694-7a5b2b0288b2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:51.241730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 117/232] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:51 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:51.247892 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686f2f-dbbd-43f4-a694-7a5b2b0288b2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:51.264713 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 116/233] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:30:50 2022] PUT /identity/v3/projects/553fd0a11f484754beb16edeccbddc21/users/5c0884f4e93a4fdd9a5aaf8e13258e8c/roles/efaf387c51e14931820f2a9b33ac5175 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:30:51.279741 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e2902-1f23-46f7-b63e-20cc8ef6798c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:51.280037 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e2902-1f23-46f7-b63e-20cc8ef6798c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:51.280323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e2902-1f23-46f7-b63e-20cc8ef6798c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:51.282233 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 117/234] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:30:51.289104 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19426e9-0cf5-4fd1-a58a-a92e0e9d27dc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:51.289504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19426e9-0cf5-4fd1-a58a-a92e0e9d27dc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:51.289794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19426e9-0cf5-4fd1-a58a-a92e0e9d27dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:51.325262 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c19426e9-0cf5-4fd1-a58a-a92e0e9d27dc None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:51.326919 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c19426e9-0cf5-4fd1-a58a-a92e0e9d27dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:51.449081 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a686f2f-dbbd-43f4-a694-7a5b2b0288b2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:51.486191 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 118/235] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:30:51.486770 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:51.514579 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19426e9-0cf5-4fd1-a58a-a92e0e9d27dc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:51.520231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3908467-71fa-4317-a714-c619d4b628de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:51.520231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3908467-71fa-4317-a714-c619d4b628de None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:51.520231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3908467-71fa-4317-a714-c619d4b628de None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:51.520231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3908467-71fa-4317-a714-c619d4b628de None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21/users/5c0884f4e93a4fdd9a5aaf8e13258e8c/roles/f0b3744c39ca4eb7b78ef642c0175a0a` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:51.521606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3908467-71fa-4317-a714-c619d4b628de None admin] RBAC: Authorizing `identity:create_grant(project_id=553fd0a11f484754beb16edeccbddc21, user_id=5c0884f4e93a4fdd9a5aaf8e13258e8c, role_id=f0b3744c39ca4eb7b78ef642c0175a0a)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:51.526521 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3908467-71fa-4317-a714-c619d4b628de None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:51.543071 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 118/236] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:30:51 2022] PUT /identity/v3/projects/553fd0a11f484754beb16edeccbddc21/users/5c0884f4e93a4fdd9a5aaf8e13258e8c/roles/f0b3744c39ca4eb7b78ef642c0175a0a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 09:30:51.641332 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:51.647764 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61f78a-3a6d-42a1-88d1-56cbea5b3019 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:51.648081 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61f78a-3a6d-42a1-88d1-56cbea5b3019 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:51.648335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61f78a-3a6d-42a1-88d1-56cbea5b3019 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:51.654577 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 119/237] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:30:51.658073 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaf8e4-3173-4d90-89ca-a5c573d66fa0 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:51.659242 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaf8e4-3173-4d90-89ca-a5c573d66fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:51.659648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaf8e4-3173-4d90-89ca-a5c573d66fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:51.686226 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19426e9-0cf5-4fd1-a58a-a92e0e9d27dc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:51.715863 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-26aaf8e4-3173-4d90-89ca-a5c573d66fa0 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:51.717071 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-26aaf8e4-3173-4d90-89ca-a5c573d66fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:51.733754 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d241000-7bc4-46d1-b1af-599ec00b17d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:51.735508 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d241000-7bc4-46d1-b1af-599ec00b17d3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:51.736927 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d241000-7bc4-46d1-b1af-599ec00b17d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:51.737391 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d241000-7bc4-46d1-b1af-599ec00b17d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:51.753390 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d241000-7bc4-46d1-b1af-599ec00b17d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1d241000-7bc4-46d1-b1af-599ec00b17d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:51.763628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:51.764787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:51.765762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:51.765762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:51.765762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:51.765762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:51.765762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:51.765762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:51.765762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:51.765762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:51.765762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:51.765762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:51.765762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:30:51.765762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:30:51.768628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 119/238] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:51.780225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d241000-7bc4-46d1-b1af-599ec00b17d3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:51.867313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 120/239] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:51.894329 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aaf8e4-3173-4d90-89ca-a5c573d66fa0 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:51.929143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d241000-7bc4-46d1-b1af-599ec00b17d3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:51.961292 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:51.970376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907c254-70ce-498f-90ce-6c37f1df98cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:51.970376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907c254-70ce-498f-90ce-6c37f1df98cc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:51.970376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907c254-70ce-498f-90ce-6c37f1df98cc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:51.970714 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907c254-70ce-498f-90ce-6c37f1df98cc None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:51.971465 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907c254-70ce-498f-90ce-6c37f1df98cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:51.971913 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907c254-70ce-498f-90ce-6c37f1df98cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:51.978624 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907c254-70ce-498f-90ce-6c37f1df98cc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:52.011180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 120/240] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:30:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:52.016716 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907c254-70ce-498f-90ce-6c37f1df98cc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:52.141869 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aaf8e4-3173-4d90-89ca-a5c573d66fa0 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:52.147267 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:52.209841 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907c254-70ce-498f-90ce-6c37f1df98cc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:52.253215 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecdbf7-f746-4271-a788-f603bedef96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:52.254122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecdbf7-f746-4271-a788-f603bedef96b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:52.254342 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecdbf7-f746-4271-a788-f603bedef96b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:52.254635 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecdbf7-f746-4271-a788-f603bedef96b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:52.256645 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecdbf7-f746-4271-a788-f603bedef96b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:52.259816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bfa9b-5d2d-4dee-9467-b7dbbe38a76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:52.260728 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bfa9b-5d2d-4dee-9467-b7dbbe38a76d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:52.261012 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bfa9b-5d2d-4dee-9467-b7dbbe38a76d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:52.261290 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bfa9b-5d2d-4dee-9467-b7dbbe38a76d None admin] PATH_INFO: `/v3/users/c3ee68e0d6ad4d8b9af6d849abde0d8e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:52.262652 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecdbf7-f746-4271-a788-f603bedef96b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:52.268942 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 121/241] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:30:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:52.287480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecdbf7-f746-4271-a788-f603bedef96b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:52.291729 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bfa9b-5d2d-4dee-9467-b7dbbe38a76d None admin] RBAC: Authorizing `identity:get_user(user_id=c3ee68e0d6ad4d8b9af6d849abde0d8e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:52.298280 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bfa9b-5d2d-4dee-9467-b7dbbe38a76d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:52.305267 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 121/242] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:52 2022] GET /identity/v3/users/c3ee68e0d6ad4d8b9af6d849abde0d8e => generated 297 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:52.311129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bfa9b-5d2d-4dee-9467-b7dbbe38a76d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:52.423782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:52.474975 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bfa9b-5d2d-4dee-9467-b7dbbe38a76d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:52.521920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b145f33-d9a9-4e41-ae8b-6cecc08890a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:52.521920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b145f33-d9a9-4e41-ae8b-6cecc08890a7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:52.521920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b145f33-d9a9-4e41-ae8b-6cecc08890a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:52.521920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b145f33-d9a9-4e41-ae8b-6cecc08890a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:52.552794 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecdbf7-f746-4271-a788-f603bedef96b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:52.645722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b145f33-d9a9-4e41-ae8b-6cecc08890a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:52.647562 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b145f33-d9a9-4e41-ae8b-6cecc08890a7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:52.663820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd4c3c-8629-416e-9cbe-bf93f4307274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:52.665363 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd4c3c-8629-416e-9cbe-bf93f4307274 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:52.666130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd4c3c-8629-416e-9cbe-bf93f4307274 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:52.666852 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd4c3c-8629-416e-9cbe-bf93f4307274 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:52.668511 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd4c3c-8629-416e-9cbe-bf93f4307274 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:52.671694 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd4c3c-8629-416e-9cbe-bf93f4307274 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:52.717797 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:52.727152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 122/243] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:30:52 2022] POST /identity/v3/users => generated 293 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 09:30:52.863138 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 122/244] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 09:30:52.870580 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd4c3c-8629-416e-9cbe-bf93f4307274 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:52.925549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:53.036616 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd4c3c-8629-416e-9cbe-bf93f4307274 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:53.077713 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d56ac-fa24-4fd1-9830-ab3b581ecd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:53.078691 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d56ac-fa24-4fd1-9830-ab3b581ecd1d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:53.078981 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d56ac-fa24-4fd1-9830-ab3b581ecd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:53.079266 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d56ac-fa24-4fd1-9830-ab3b581ecd1d None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:53.080690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d56ac-fa24-4fd1-9830-ab3b581ecd1d None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:53.082206 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d56ac-fa24-4fd1-9830-ab3b581ecd1d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:53.084454 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 123/245] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:52 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:53.090127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b145f33-d9a9-4e41-ae8b-6cecc08890a7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:53.204527 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b145f33-d9a9-4e41-ae8b-6cecc08890a7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:53.243725 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe6062-dadf-42ce-a6ad-697f4d28a6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:53.244630 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe6062-dadf-42ce-a6ad-697f4d28a6ee None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:53.244788 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe6062-dadf-42ce-a6ad-697f4d28a6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:53.245144 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe6062-dadf-42ce-a6ad-697f4d28a6ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:53.245797 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe6062-dadf-42ce-a6ad-697f4d28a6ee None admin] RBAC: Adding query filter params (role.id=50aac635500847d795e12adf460cbe94, scope.project.id=553fd0a11f484754beb16edeccbddc21, user.id=c3ee68e0d6ad4d8b9af6d849abde0d8e) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:53.246115 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe6062-dadf-42ce-a6ad-697f4d28a6ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:53.247612 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe6062-dadf-42ce-a6ad-697f4d28a6ee None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:53.255152 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 123/246] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:53 2022] GET /identity/v3/role_assignments?user.id=c3ee68e0d6ad4d8b9af6d849abde0d8e&scope.project.id=553fd0a11f484754beb16edeccbddc21&role.id=50aac635500847d795e12adf460cbe94 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:30:54.101198 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cdf49-dda4-499f-8979-160bb08ce3e2 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:54.101962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cdf49-dda4-499f-8979-160bb08ce3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:54.101962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cdf49-dda4-499f-8979-160bb08ce3e2 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:54.103368 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 124/247] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:30:54.109506 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1583ed-4d58-4d11-8ce6-87359cf5d7e2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:54.109887 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1583ed-4d58-4d11-8ce6-87359cf5d7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:54.110123 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1583ed-4d58-4d11-8ce6-87359cf5d7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:54.128590 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ce1583ed-4d58-4d11-8ce6-87359cf5d7e2 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:54.129800 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ce1583ed-4d58-4d11-8ce6-87359cf5d7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:54.150980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:54.226624 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 124/248] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:54.250691 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cdf49-dda4-499f-8979-160bb08ce3e2 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:54.472341 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:54.484501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cdf49-dda4-499f-8979-160bb08ce3e2 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:54.574080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833c823-5623-4bb4-aa31-718846959ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:54.575454 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833c823-5623-4bb4-aa31-718846959ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:54.575959 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833c823-5623-4bb4-aa31-718846959ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:54.576455 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833c823-5623-4bb4-aa31-718846959ca6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:54.610553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833c823-5623-4bb4-aa31-718846959ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-2833c823-5623-4bb4-aa31-718846959ca6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:54.626956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:54.628789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:54.630295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:54.630295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:54.630295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:54.630295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:54.630295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:54.630295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:54.630295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:54.630295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:54.630295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:54.630295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:54.630295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:30:54.630295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:54.633986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 125/249] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:30:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:30:54.635662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1583ed-4d58-4d11-8ce6-87359cf5d7e2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:54.830316 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1583ed-4d58-4d11-8ce6-87359cf5d7e2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:54.883505 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb9cf8-1f12-49da-88d1-962d0541df61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:54.884206 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb9cf8-1f12-49da-88d1-962d0541df61 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:54.884493 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb9cf8-1f12-49da-88d1-962d0541df61 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:54.884774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb9cf8-1f12-49da-88d1-962d0541df61 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:54.885547 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb9cf8-1f12-49da-88d1-962d0541df61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:54.885863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb9cf8-1f12-49da-88d1-962d0541df61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:54.887388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb9cf8-1f12-49da-88d1-962d0541df61 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:54.903751 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 125/250] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:54.910542 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833c823-5623-4bb4-aa31-718846959ca6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:55.177402 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833c823-5623-4bb4-aa31-718846959ca6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:55.260924 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cec7e-7364-4acd-af9b-c046662477b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:55.262178 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cec7e-7364-4acd-af9b-c046662477b0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:55.262686 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cec7e-7364-4acd-af9b-c046662477b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:55.263161 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cec7e-7364-4acd-af9b-c046662477b0 None admin] PATH_INFO: `/v3/users/5c0884f4e93a4fdd9a5aaf8e13258e8c` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:55.264634 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cec7e-7364-4acd-af9b-c046662477b0 None admin] RBAC: Authorizing `identity:get_user(user_id=5c0884f4e93a4fdd9a5aaf8e13258e8c)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:55.266885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cec7e-7364-4acd-af9b-c046662477b0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:55.269090 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 126/251] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:54 2022] GET /identity/v3/users/5c0884f4e93a4fdd9a5aaf8e13258e8c => generated 283 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:55.277765 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb9cf8-1f12-49da-88d1-962d0541df61 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:55.293190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340ce0-42ab-4c5d-8a50-a7822ab13913 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:55.293847 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340ce0-42ab-4c5d-8a50-a7822ab13913 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:55.294327 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340ce0-42ab-4c5d-8a50-a7822ab13913 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:55.296310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 127/252] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:30:55.310465 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:55.316632 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b727d55-9207-4c97-a2d9-42eb20c3d56d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:55.317305 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b727d55-9207-4c97-a2d9-42eb20c3d56d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:55.317825 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b727d55-9207-4c97-a2d9-42eb20c3d56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:55.345154 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1b727d55-9207-4c97-a2d9-42eb20c3d56d None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:55.346822 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1b727d55-9207-4c97-a2d9-42eb20c3d56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:55.395070 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:55.557294 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 128/253] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:30:55.615877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb9cf8-1f12-49da-88d1-962d0541df61 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:55.644667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b727d55-9207-4c97-a2d9-42eb20c3d56d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:55.681033 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1a459-dcdd-45e3-b11d-b5fdda883e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:55.682173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1a459-dcdd-45e3-b11d-b5fdda883e4d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:55.682715 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1a459-dcdd-45e3-b11d-b5fdda883e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:55.683211 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1a459-dcdd-45e3-b11d-b5fdda883e4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:55.816673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1a459-dcdd-45e3-b11d-b5fdda883e4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:55.819774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1a459-dcdd-45e3-b11d-b5fdda883e4d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:55.839874 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:56.010994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b727d55-9207-4c97-a2d9-42eb20c3d56d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:56.018176 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 126/254] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:30:56.025684 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d071f-3810-4ec7-94c8-a261588758e7 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:56.026483 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d071f-3810-4ec7-94c8-a261588758e7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:56.027195 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d071f-3810-4ec7-94c8-a261588758e7 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:56.030064 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 127/255] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:56 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:56.036088 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d071f-3810-4ec7-94c8-a261588758e7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:56.152380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c6f0c-eeff-428a-94ce-4da91f249327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:56.154147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c6f0c-eeff-428a-94ce-4da91f249327 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:56.157574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c6f0c-eeff-428a-94ce-4da91f249327 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:56.158311 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c6f0c-eeff-428a-94ce-4da91f249327 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:56.197963 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c6f0c-eeff-428a-94ce-4da91f249327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-5a7c6f0c-eeff-428a-94ce-4da91f249327 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:56.217430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:56.219564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:56.221359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:56.221359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:56.221359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:56.221359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:56.221359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:56.221359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:56.221359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:56.221359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:56.221359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:56.221359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:56.221359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:56.221359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:56.225805 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 129/256] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 582 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:56.228776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda9c20-230e-404e-8455-f05bb17bb5d7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:56.229561 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda9c20-230e-404e-8455-f05bb17bb5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:56.230587 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda9c20-230e-404e-8455-f05bb17bb5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:56.265660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-edda9c20-230e-404e-8455-f05bb17bb5d7 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:56.268139 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-edda9c20-230e-404e-8455-f05bb17bb5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:56.291631 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:56.403799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d071f-3810-4ec7-94c8-a261588758e7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:56.427057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 130/257] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:56.429038 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda9c20-230e-404e-8455-f05bb17bb5d7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:56.437245 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:56.533982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a3acf-f0de-4f10-b6d2-c35014ffbd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:56.535583 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a3acf-f0de-4f10-b6d2-c35014ffbd1b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:56.536088 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a3acf-f0de-4f10-b6d2-c35014ffbd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:56.536596 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a3acf-f0de-4f10-b6d2-c35014ffbd1b None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:56.548180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a3acf-f0de-4f10-b6d2-c35014ffbd1b None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:56.550947 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a3acf-f0de-4f10-b6d2-c35014ffbd1b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:56.558433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 128/258] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:56 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:56.562745 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a3acf-f0de-4f10-b6d2-c35014ffbd1b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:56.770177 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda9c20-230e-404e-8455-f05bb17bb5d7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:56.863612 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a3acf-f0de-4f10-b6d2-c35014ffbd1b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:56.905431 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4d12-b054-478c-a310-eb396a37bb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:56.907062 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4d12-b054-478c-a310-eb396a37bb15 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:56.907537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4d12-b054-478c-a310-eb396a37bb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:56.908028 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4d12-b054-478c-a310-eb396a37bb15 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:56.909501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa4d12-b054-478c-a310-eb396a37bb15 None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:56.910021 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa4d12-b054-478c-a310-eb396a37bb15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:56.920314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa4d12-b054-478c-a310-eb396a37bb15 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:56.943956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 131/259] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:30:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:56.947789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4d12-b054-478c-a310-eb396a37bb15 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:56.951576 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cb1ad-884d-44de-8fab-214be187c8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:56.954009 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cb1ad-884d-44de-8fab-214be187c8ab None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:56.954868 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cb1ad-884d-44de-8fab-214be187c8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:56.956505 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cb1ad-884d-44de-8fab-214be187c8ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:56.995052 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:57.008636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cb1ad-884d-44de-8fab-214be187c8ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-aa3cb1ad-884d-44de-8fab-214be187c8ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:57.047177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:57.048959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:57.050558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:57.050558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:57.050558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:57.050558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:57.050558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:57.050558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:57.050558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:57.050558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:57.050558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:57.050558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:57.050558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:30:57.050558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:30:57.050558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 129/260] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:30:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 488 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:57.051839 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cb1ad-884d-44de-8fab-214be187c8ab None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:57.175019 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:57.217254 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4d12-b054-478c-a310-eb396a37bb15 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:57.344094 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1083e7-bd86-45f4-a79c-059f57aa3928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:57.345187 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1083e7-bd86-45f4-a79c-059f57aa3928 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:57.345697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1083e7-bd86-45f4-a79c-059f57aa3928 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:57.346210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1083e7-bd86-45f4-a79c-059f57aa3928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:57.348053 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1083e7-bd86-45f4-a79c-059f57aa3928 None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=553fd0a11f484754beb16edeccbddc21, user.id=5c0884f4e93a4fdd9a5aaf8e13258e8c) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:57.348610 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1083e7-bd86-45f4-a79c-059f57aa3928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:57.359838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1083e7-bd86-45f4-a79c-059f57aa3928 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:57.366776 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cb1ad-884d-44de-8fab-214be187c8ab None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:57.380894 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 132/261] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:56 2022] GET /identity/v3/role_assignments?user.id=5c0884f4e93a4fdd9a5aaf8e13258e8c&scope.project.id=553fd0a11f484754beb16edeccbddc21&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 608 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:57.382827 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1083e7-bd86-45f4-a79c-059f57aa3928 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:57.530540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5413a5-3b31-44e8-9181-5df64551ac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:57.530540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5413a5-3b31-44e8-9181-5df64551ac7b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:57.530540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5413a5-3b31-44e8-9181-5df64551ac7b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:57.530540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5413a5-3b31-44e8-9181-5df64551ac7b None admin] PATH_INFO: `/v3/users/b055fec304d64b4d8f980a8f66760ef2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:57.536059 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5413a5-3b31-44e8-9181-5df64551ac7b None admin] RBAC: Authorizing `identity:get_user(user_id=b055fec304d64b4d8f980a8f66760ef2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:57.547696 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5413a5-3b31-44e8-9181-5df64551ac7b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:57.554531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 130/262] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:57 2022] GET /identity/v3/users/b055fec304d64b4d8f980a8f66760ef2 => generated 297 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:57.560545 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5413a5-3b31-44e8-9181-5df64551ac7b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:57.706258 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:57.778814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1083e7-bd86-45f4-a79c-059f57aa3928 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:57.860885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9d779-0e76-4b62-bd8d-610e8234ab23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:57.861689 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5413a5-3b31-44e8-9181-5df64551ac7b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:57.862078 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d779-0e76-4b62-bd8d-610e8234ab23 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:57.862570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d779-0e76-4b62-bd8d-610e8234ab23 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:57.863436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d779-0e76-4b62-bd8d-610e8234ab23 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:57.864941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9d779-0e76-4b62-bd8d-610e8234ab23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:57.865483 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9d779-0e76-4b62-bd8d-610e8234ab23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:57.867031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:57.872885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9d779-0e76-4b62-bd8d-610e8234ab23 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:57.891796 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 133/263] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:30:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 510 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:57.897727 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9d779-0e76-4b62-bd8d-610e8234ab23 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:57.962423 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ea2a2-736a-4965-8e51-ca90d4b7aa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:57.964863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ea2a2-736a-4965-8e51-ca90d4b7aa90 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:57.965719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ea2a2-736a-4965-8e51-ca90d4b7aa90 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:57.966181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ea2a2-736a-4965-8e51-ca90d4b7aa90 None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:57.972023 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ea2a2-736a-4965-8e51-ca90d4b7aa90 None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:57.974893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ea2a2-736a-4965-8e51-ca90d4b7aa90 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:57.980427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 131/264] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:57 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:57.986047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a79ae-dd1f-4790-a7fd-f45837fb2059 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:57.987200 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a79ae-dd1f-4790-a7fd-f45837fb2059 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:57.987699 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a79ae-dd1f-4790-a7fd-f45837fb2059 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:57.990982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 132/265] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:57.993499 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0da5d-4c2b-4637-baab-b32e036eaf69 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:57.994003 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0da5d-4c2b-4637-baab-b32e036eaf69 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:57.994477 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0da5d-4c2b-4637-baab-b32e036eaf69 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:57.997771 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 133/266] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:58.000157 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0da5d-4c2b-4637-baab-b32e036eaf69 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:58.096695 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9d779-0e76-4b62-bd8d-610e8234ab23 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:58.133445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:58.141203 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2111c6b-c034-495c-b210-cb958ef7c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:58.142125 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2111c6b-c034-495c-b210-cb958ef7c570 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:58.142430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2111c6b-c034-495c-b210-cb958ef7c570 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:58.142741 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2111c6b-c034-495c-b210-cb958ef7c570 None admin] PATH_INFO: `/v3/users/5c0884f4e93a4fdd9a5aaf8e13258e8c` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:58.144136 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2111c6b-c034-495c-b210-cb958ef7c570 None admin] RBAC: Authorizing `identity:get_user(user_id=5c0884f4e93a4fdd9a5aaf8e13258e8c)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:58.145689 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2111c6b-c034-495c-b210-cb958ef7c570 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:58.156737 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 134/267] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:57 2022] GET /identity/v3/users/5c0884f4e93a4fdd9a5aaf8e13258e8c => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:58.156737 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa91a2-ddf5-41fb-9f68-c29c07026826 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:58.156737 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa91a2-ddf5-41fb-9f68-c29c07026826 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:58.156737 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa91a2-ddf5-41fb-9f68-c29c07026826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:58.172222 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b9fa91a2-ddf5-41fb-9f68-c29c07026826 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:58.173615 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b9fa91a2-ddf5-41fb-9f68-c29c07026826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:58.203238 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0da5d-4c2b-4637-baab-b32e036eaf69 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:58.260738 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8726a0-e984-4540-9d6d-cacb3134dc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:58.261873 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8726a0-e984-4540-9d6d-cacb3134dc7d None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:58.262341 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8726a0-e984-4540-9d6d-cacb3134dc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:58.262767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8726a0-e984-4540-9d6d-cacb3134dc7d None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21/users/b055fec304d64b4d8f980a8f66760ef2/roles/edcc1e17fab74f2d93941e3c37b66546` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:58.265721 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8726a0-e984-4540-9d6d-cacb3134dc7d None admin] RBAC: Authorizing `identity:create_grant(project_id=553fd0a11f484754beb16edeccbddc21, user_id=b055fec304d64b4d8f980a8f66760ef2, role_id=edcc1e17fab74f2d93941e3c37b66546)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:58.267568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8726a0-e984-4540-9d6d-cacb3134dc7d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:58.272670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 135/268] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:58.275643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89093d69-df73-428a-bf27-bccee6d2cd8e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:58.276190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89093d69-df73-428a-bf27-bccee6d2cd8e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:58.276694 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89093d69-df73-428a-bf27-bccee6d2cd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:58.297800 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 134/269] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:30:57 2022] PUT /identity/v3/projects/553fd0a11f484754beb16edeccbddc21/users/b055fec304d64b4d8f980a8f66760ef2/roles/edcc1e17fab74f2d93941e3c37b66546 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:30:58.299632 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8726a0-e984-4540-9d6d-cacb3134dc7d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:58.320496 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-89093d69-df73-428a-bf27-bccee6d2cd8e None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:58.322703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-89093d69-df73-428a-bf27-bccee6d2cd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:58.357763 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:58.440139 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 136/270] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:58.447359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768742c-daa4-4a7f-8787-3113289296b8 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:58.447359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768742c-daa4-4a7f-8787-3113289296b8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:58.447359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768742c-daa4-4a7f-8787-3113289296b8 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:58.447359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 137/271] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:30:58.447359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768742c-daa4-4a7f-8787-3113289296b8 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:58.511843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8726a0-e984-4540-9d6d-cacb3134dc7d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:58.527094 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:58.589803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96467dcd-bcb4-4dc4-9fbd-4af91e20ccc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:58.590762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96467dcd-bcb4-4dc4-9fbd-4af91e20ccc4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:58.591228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96467dcd-bcb4-4dc4-9fbd-4af91e20ccc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:58.591685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96467dcd-bcb4-4dc4-9fbd-4af91e20ccc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:58.596892 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768742c-daa4-4a7f-8787-3113289296b8 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:58.661793 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce0407-3fea-47b9-8899-4beb81c61f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:58.663214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0407-3fea-47b9-8899-4beb81c61f2e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:58.663730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0407-3fea-47b9-8899-4beb81c61f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:58.664328 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0407-3fea-47b9-8899-4beb81c61f2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:58.682484 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce0407-3fea-47b9-8899-4beb81c61f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-46ce0407-3fea-47b9-8899-4beb81c61f2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:58.697651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:58.699828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:58.701287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:58.701287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:58.701287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:58.701287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:58.701287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:58.701287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:58.701287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:58.701287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:58.701287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:58.701287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:58.701287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:30:58.701287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:58.701287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 138/272] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:58.704377 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dbe9c-c892-4fb6-b078-e133d158b2a2 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:58.704377 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dbe9c-c892-4fb6-b078-e133d158b2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:58.704377 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dbe9c-c892-4fb6-b078-e133d158b2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:58.718997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96467dcd-bcb4-4dc4-9fbd-4af91e20ccc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:58.721767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96467dcd-bcb4-4dc4-9fbd-4af91e20ccc4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:58.724146 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5a6dbe9c-c892-4fb6-b078-e133d158b2a2 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:30:58.725694 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5a6dbe9c-c892-4fb6-b078-e133d158b2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:30:58.787001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:58.820374 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 139/273] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:30:58.821798 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dbe9c-c892-4fb6-b078-e133d158b2a2 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:58.906656 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 135/274] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:30:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:30:58.909102 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96467dcd-bcb4-4dc4-9fbd-4af91e20ccc4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:58.919291 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:59.001353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dbe9c-c892-4fb6-b078-e133d158b2a2 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:59.050074 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96467dcd-bcb4-4dc4-9fbd-4af91e20ccc4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:59.052744 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea2ada-7b39-43ea-a3a3-7ceafdfa24ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:59.054124 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea2ada-7b39-43ea-a3a3-7ceafdfa24ae None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:59.054568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea2ada-7b39-43ea-a3a3-7ceafdfa24ae None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:59.054997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea2ada-7b39-43ea-a3a3-7ceafdfa24ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:59.077646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea2ada-7b39-43ea-a3a3-7ceafdfa24ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-74ea2ada-7b39-43ea-a3a3-7ceafdfa24ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:30:59.093426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:30:59.095619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:30:59.098346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:30:59.098346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:30:59.098346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:30:59.098346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:30:59.098346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:30:59.098346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:30:59.098346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:30:59.098346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:30:59.098346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:30:59.098346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:30:59.098346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:30:59.098346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:30:59.098346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 140/275] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:30:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:30:59.098346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea2ada-7b39-43ea-a3a3-7ceafdfa24ae None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:59.100495 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:59.107870 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7791e6e-beda-4c51-ad65-2ce18eb1fb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:59.109729 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7791e6e-beda-4c51-ad65-2ce18eb1fb51 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:59.110185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7791e6e-beda-4c51-ad65-2ce18eb1fb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:59.110645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7791e6e-beda-4c51-ad65-2ce18eb1fb51 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:59.111650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7791e6e-beda-4c51-ad65-2ce18eb1fb51 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:59.112149 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7791e6e-beda-4c51-ad65-2ce18eb1fb51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:59.113803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7791e6e-beda-4c51-ad65-2ce18eb1fb51 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:59.127341 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 136/276] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:30:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:59.129532 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7791e6e-beda-4c51-ad65-2ce18eb1fb51 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:59.290776 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7791e6e-beda-4c51-ad65-2ce18eb1fb51 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:59.291640 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea2ada-7b39-43ea-a3a3-7ceafdfa24ae None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:59.305593 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:59.335628 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991adca0-9913-4c4b-bc7b-f37c88c6d4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:59.336438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991adca0-9913-4c4b-bc7b-f37c88c6d4ac None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:59.336715 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991adca0-9913-4c4b-bc7b-f37c88c6d4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:59.337001 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991adca0-9913-4c4b-bc7b-f37c88c6d4ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:59.338380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991adca0-9913-4c4b-bc7b-f37c88c6d4ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:59.339792 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991adca0-9913-4c4b-bc7b-f37c88c6d4ac None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:59.341778 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 141/277] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:30:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:59.342432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991adca0-9913-4c4b-bc7b-f37c88c6d4ac None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:59.361638 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf67e8-ff84-4f67-bb22-1c1ea5a70de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:59.362539 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf67e8-ff84-4f67-bb22-1c1ea5a70de8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:59.362841 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf67e8-ff84-4f67-bb22-1c1ea5a70de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:59.363255 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf67e8-ff84-4f67-bb22-1c1ea5a70de8 None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:59.364391 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf67e8-ff84-4f67-bb22-1c1ea5a70de8 None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:59.365852 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf67e8-ff84-4f67-bb22-1c1ea5a70de8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:59.367881 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 137/278] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:30:59 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:59.368798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf67e8-ff84-4f67-bb22-1c1ea5a70de8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:59.486061 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:59.534231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991adca0-9913-4c4b-bc7b-f37c88c6d4ac None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:59.557261 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf67e8-ff84-4f67-bb22-1c1ea5a70de8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:59.584299 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1d009-46e6-4bdd-b398-0a4f794f357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:59.585313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1d009-46e6-4bdd-b398-0a4f794f357b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:59.585791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1d009-46e6-4bdd-b398-0a4f794f357b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:59.586251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1d009-46e6-4bdd-b398-0a4f794f357b None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:59.587255 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1d009-46e6-4bdd-b398-0a4f794f357b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:59.587574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1d009-46e6-4bdd-b398-0a4f794f357b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:59.588986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1d009-46e6-4bdd-b398-0a4f794f357b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:59.599611 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 142/279] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:30:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:59.600464 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1d009-46e6-4bdd-b398-0a4f794f357b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:59.643163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397f0d3-49c8-40ad-8ca3-d0d418b60702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:59.644654 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397f0d3-49c8-40ad-8ca3-d0d418b60702 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:59.646270 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397f0d3-49c8-40ad-8ca3-d0d418b60702 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:59.646994 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397f0d3-49c8-40ad-8ca3-d0d418b60702 None admin] PATH_INFO: `/v3/users/b9a72c2673ea4a0c8a8bfb5899bb8b21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:59.648234 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:59.678280 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397f0d3-49c8-40ad-8ca3-d0d418b60702 None admin] RBAC: Authorizing `identity:get_user(user_id=b9a72c2673ea4a0c8a8bfb5899bb8b21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:59.681323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397f0d3-49c8-40ad-8ca3-d0d418b60702 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:59.684733 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 138/280] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:59 2022] GET /identity/v3/users/b9a72c2673ea4a0c8a8bfb5899bb8b21 => generated 293 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:59.690239 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397f0d3-49c8-40ad-8ca3-d0d418b60702 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:59.752631 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1d009-46e6-4bdd-b398-0a4f794f357b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:59.815061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd3847-75c5-4119-9b91-1adc9c7ef3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:59.815869 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd3847-75c5-4119-9b91-1adc9c7ef3fe None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:59.816290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd3847-75c5-4119-9b91-1adc9c7ef3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:59.816724 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd3847-75c5-4119-9b91-1adc9c7ef3fe None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:59.817609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd3847-75c5-4119-9b91-1adc9c7ef3fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:59.819771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd3847-75c5-4119-9b91-1adc9c7ef3fe None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:59.844213 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 143/281] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:30:59 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:30:59.845099 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd3847-75c5-4119-9b91-1adc9c7ef3fe None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:30:59.875654 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397f0d3-49c8-40ad-8ca3-d0d418b60702 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:59.924128 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:59.956016 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2214dab-2bcc-46a2-a763-d6854294f2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:30:59.957782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2214dab-2bcc-46a2-a763-d6854294f2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:30:59.958307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2214dab-2bcc-46a2-a763-d6854294f2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:30:59.958966 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2214dab-2bcc-46a2-a763-d6854294f2e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:30:59.960828 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2214dab-2bcc-46a2-a763-d6854294f2e6 None admin] RBAC: Adding query filter params (role.id=f0b3744c39ca4eb7b78ef642c0175a0a, scope.project.id=553fd0a11f484754beb16edeccbddc21, user.id=5c0884f4e93a4fdd9a5aaf8e13258e8c) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:30:59.961646 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2214dab-2bcc-46a2-a763-d6854294f2e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:30:59.964744 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2214dab-2bcc-46a2-a763-d6854294f2e6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:30:59.966563 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:30:59.975032 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd3847-75c5-4119-9b91-1adc9c7ef3fe None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:30:59.990909 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 139/282] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:30:59 2022] GET /identity/v3/role_assignments?user.id=5c0884f4e93a4fdd9a5aaf8e13258e8c&scope.project.id=553fd0a11f484754beb16edeccbddc21&role.id=f0b3744c39ca4eb7b78ef642c0175a0a => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:30:59.993626 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2214dab-2bcc-46a2-a763-d6854294f2e6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:00.025476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c044b-8ca0-405f-891a-d3af7916ee22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:00.029275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c044b-8ca0-405f-891a-d3af7916ee22 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:00.029694 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c044b-8ca0-405f-891a-d3af7916ee22 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:00.030553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c044b-8ca0-405f-891a-d3af7916ee22 None admin] PATH_INFO: `/v3/users/c3ee68e0d6ad4d8b9af6d849abde0d8e` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:00.034552 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c044b-8ca0-405f-891a-d3af7916ee22 None admin] RBAC: Authorizing `identity:get_user(user_id=c3ee68e0d6ad4d8b9af6d849abde0d8e)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:00.036312 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c044b-8ca0-405f-891a-d3af7916ee22 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:00.038827 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 144/283] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:30:59 2022] GET /identity/v3/users/c3ee68e0d6ad4d8b9af6d849abde0d8e => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:00.044778 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c044b-8ca0-405f-891a-d3af7916ee22 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:00.241497 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c044b-8ca0-405f-891a-d3af7916ee22 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:00.265378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2214dab-2bcc-46a2-a763-d6854294f2e6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:00.312400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c1e51-328c-435a-92e1-fac50d83f70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:00.314924 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c1e51-328c-435a-92e1-fac50d83f70f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:00.315911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c1e51-328c-435a-92e1-fac50d83f70f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:00.317171 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c1e51-328c-435a-92e1-fac50d83f70f None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:00.320197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c1e51-328c-435a-92e1-fac50d83f70f None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:00.321994 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17ee0f-1c70-473f-b87d-36b9371d6838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:00.322816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17ee0f-1c70-473f-b87d-36b9371d6838 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:00.323208 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17ee0f-1c70-473f-b87d-36b9371d6838 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:00.323596 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17ee0f-1c70-473f-b87d-36b9371d6838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:00.324157 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c1e51-328c-435a-92e1-fac50d83f70f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:00.324722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17ee0f-1c70-473f-b87d-36b9371d6838 None admin] RBAC: Adding query filter params (role.id=edcc1e17fab74f2d93941e3c37b66546, user.id=b9a72c2673ea4a0c8a8bfb5899bb8b21, scope.system=all) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:00.325832 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17ee0f-1c70-473f-b87d-36b9371d6838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:00.328252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17ee0f-1c70-473f-b87d-36b9371d6838 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:00.328685 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 145/284] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:00 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:00.337860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c1e51-328c-435a-92e1-fac50d83f70f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:00.340694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 140/285] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Jun 15 09:30:59 2022] GET /identity/v3/role_assignments?user.id=b9a72c2673ea4a0c8a8bfb5899bb8b21&scope.system=all&role.id=edcc1e17fab74f2d93941e3c37b66546 => generated 226 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:00.412545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:00.579613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c1e51-328c-435a-92e1-fac50d83f70f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:00.652956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdc39e-4393-4ebc-92b3-a46e5253dc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:00.655084 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdc39e-4393-4ebc-92b3-a46e5253dc04 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:00.655885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdc39e-4393-4ebc-92b3-a46e5253dc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:00.656609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdc39e-4393-4ebc-92b3-a46e5253dc04 None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21/users/c3ee68e0d6ad4d8b9af6d849abde0d8e/roles/50aac635500847d795e12adf460cbe94` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:00.662597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdc39e-4393-4ebc-92b3-a46e5253dc04 None admin] RBAC: Authorizing `identity:create_grant(project_id=553fd0a11f484754beb16edeccbddc21, user_id=c3ee68e0d6ad4d8b9af6d849abde0d8e, role_id=50aac635500847d795e12adf460cbe94)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:00.665834 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdc39e-4393-4ebc-92b3-a46e5253dc04 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:00.706665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 146/286] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:31:00 2022] PUT /identity/v3/projects/553fd0a11f484754beb16edeccbddc21/users/c3ee68e0d6ad4d8b9af6d849abde0d8e/roles/50aac635500847d795e12adf460cbe94 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 09:31:00.979960 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107c5dc-d082-42f7-b247-a98106d40c61 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:00.980462 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107c5dc-d082-42f7-b247-a98106d40c61 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:00.980462 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107c5dc-d082-42f7-b247-a98106d40c61 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:00.982372 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 141/287] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:00.988546 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8355b-e989-4e4f-95d7-8086e1389356 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:00.988843 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8355b-e989-4e4f-95d7-8086e1389356 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:00.989126 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8355b-e989-4e4f-95d7-8086e1389356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:01.009028 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-05d8355b-e989-4e4f-95d7-8086e1389356 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:01.010260 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-05d8355b-e989-4e4f-95d7-8086e1389356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:01.130916 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 147/288] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:01.166305 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107c5dc-d082-42f7-b247-a98106d40c61 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:01.277526 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:01.397794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107c5dc-d082-42f7-b247-a98106d40c61 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:01.463577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864e976-988e-4d4a-9b51-232aba1876ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:01.464927 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864e976-988e-4d4a-9b51-232aba1876ed None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:01.465404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864e976-988e-4d4a-9b51-232aba1876ed None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:01.465870 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864e976-988e-4d4a-9b51-232aba1876ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:01.480629 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864e976-988e-4d4a-9b51-232aba1876ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1864e976-988e-4d4a-9b51-232aba1876ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:01.495126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:01.496306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:01.497299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:01.497299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:01.497299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:01.497299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:01.497299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:01.497299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:01.497299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:01.497299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:01.497299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:01.497299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:01.497299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:01.497299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:01.498129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 142/289] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:01.503967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8355b-e989-4e4f-95d7-8086e1389356 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:01.562935 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:01.695199 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8355b-e989-4e4f-95d7-8086e1389356 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:01.761902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecaef3-aa1c-4083-b302-e7679fc2bc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:01.763146 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecaef3-aa1c-4083-b302-e7679fc2bc4c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:01.763635 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecaef3-aa1c-4083-b302-e7679fc2bc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:01.764154 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecaef3-aa1c-4083-b302-e7679fc2bc4c None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:01.765542 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecaef3-aa1c-4083-b302-e7679fc2bc4c None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:01.766058 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecaef3-aa1c-4083-b302-e7679fc2bc4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:01.768690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecaef3-aa1c-4083-b302-e7679fc2bc4c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:01.786903 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 148/290] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:31:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:01.797058 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864e976-988e-4d4a-9b51-232aba1876ed None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:01.989230 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864e976-988e-4d4a-9b51-232aba1876ed None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:02.004268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:02.036766 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524757b-f3b4-4641-aba1-b58540866569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:02.037666 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524757b-f3b4-4641-aba1-b58540866569 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:02.037948 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524757b-f3b4-4641-aba1-b58540866569 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:02.038224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524757b-f3b4-4641-aba1-b58540866569 None admin] PATH_INFO: `/v3/users/b055fec304d64b4d8f980a8f66760ef2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:02.039570 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524757b-f3b4-4641-aba1-b58540866569 None admin] RBAC: Authorizing `identity:get_user(user_id=b055fec304d64b4d8f980a8f66760ef2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:02.041045 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524757b-f3b4-4641-aba1-b58540866569 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:02.042779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 143/291] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:31:01 2022] GET /identity/v3/users/b055fec304d64b4d8f980a8f66760ef2 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:02.052565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecaef3-aa1c-4083-b302-e7679fc2bc4c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:02.197739 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:02.221043 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecaef3-aa1c-4083-b302-e7679fc2bc4c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:02.279330 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad36181-5519-40b4-a380-472e1fe91e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:02.280699 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad36181-5519-40b4-a380-472e1fe91e85 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:02.280997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad36181-5519-40b4-a380-472e1fe91e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:02.281283 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad36181-5519-40b4-a380-472e1fe91e85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:02.386935 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad36181-5519-40b4-a380-472e1fe91e85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:02.388450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad36181-5519-40b4-a380-472e1fe91e85 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:02.534897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:02.552252 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 149/292] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:02.560221 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524757b-f3b4-4641-aba1-b58540866569 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:02.795002 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524757b-f3b4-4641-aba1-b58540866569 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:02.885686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e531ec9-1c9d-446c-85e1-0364ecb2e4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:02.887224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e531ec9-1c9d-446c-85e1-0364ecb2e4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:02.887722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e531ec9-1c9d-446c-85e1-0364ecb2e4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:02.888226 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e531ec9-1c9d-446c-85e1-0364ecb2e4f6 None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:02.891161 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e531ec9-1c9d-446c-85e1-0364ecb2e4f6 None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:02.894135 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e531ec9-1c9d-446c-85e1-0364ecb2e4f6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:02.902704 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 144/293] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:02 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:02.904123 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad36181-5519-40b4-a380-472e1fe91e85 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:03.058122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad36181-5519-40b4-a380-472e1fe91e85 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:03.114085 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63784efb-45cd-4adf-8c7a-a320667972c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:03.115229 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63784efb-45cd-4adf-8c7a-a320667972c4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:03.115739 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63784efb-45cd-4adf-8c7a-a320667972c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:03.116222 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63784efb-45cd-4adf-8c7a-a320667972c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:03.117286 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63784efb-45cd-4adf-8c7a-a320667972c4 None admin] RBAC: Adding query filter params (role.id=edcc1e17fab74f2d93941e3c37b66546, scope.project.id=553fd0a11f484754beb16edeccbddc21, user.id=b055fec304d64b4d8f980a8f66760ef2) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:03.117833 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63784efb-45cd-4adf-8c7a-a320667972c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:03.119546 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63784efb-45cd-4adf-8c7a-a320667972c4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:03.131837 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 150/294] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:31:02 2022] GET /identity/v3/role_assignments?user.id=b055fec304d64b4d8f980a8f66760ef2&scope.project.id=553fd0a11f484754beb16edeccbddc21&role.id=edcc1e17fab74f2d93941e3c37b66546 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:03.149249 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b17ff7-5085-4a65-9a83-3012edb0dd57 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:03.149777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b17ff7-5085-4a65-9a83-3012edb0dd57 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:03.149900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b17ff7-5085-4a65-9a83-3012edb0dd57 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:03.151902 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 145/295] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:03.157861 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288be04e-d9e0-4dcd-8f70-826e5558d130 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:03.158515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288be04e-d9e0-4dcd-8f70-826e5558d130 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:03.159000 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288be04e-d9e0-4dcd-8f70-826e5558d130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:03.182811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-288be04e-d9e0-4dcd-8f70-826e5558d130 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:03.184405 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-288be04e-d9e0-4dcd-8f70-826e5558d130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:03.250957 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:03.293023 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 151/296] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:03.328760 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046ff30-4c0b-4a7d-8047-6e721bbeb408 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:03.329419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046ff30-4c0b-4a7d-8047-6e721bbeb408 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:03.329898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046ff30-4c0b-4a7d-8047-6e721bbeb408 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:03.332366 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288be04e-d9e0-4dcd-8f70-826e5558d130 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:03.332655 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 146/297] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:03.341772 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46fdc7-d6b9-4327-8f62-facb24960554 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:03.342219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46fdc7-d6b9-4327-8f62-facb24960554 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:03.342399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46fdc7-d6b9-4327-8f62-facb24960554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:03.379668 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0e46fdc7-d6b9-4327-8f62-facb24960554 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:03.380888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0e46fdc7-d6b9-4327-8f62-facb24960554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:03.448356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:03.478671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 147/298] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:31:03.503112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46fdc7-d6b9-4327-8f62-facb24960554 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:03.531813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288be04e-d9e0-4dcd-8f70-826e5558d130 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:03.609201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292acce4-1f06-4468-ab9c-dd73b9ffdb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:03.610783 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292acce4-1f06-4468-ab9c-dd73b9ffdb75 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:03.611256 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292acce4-1f06-4468-ab9c-dd73b9ffdb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:03.611712 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292acce4-1f06-4468-ab9c-dd73b9ffdb75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:03.614114 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292acce4-1f06-4468-ab9c-dd73b9ffdb75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:03.617170 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292acce4-1f06-4468-ab9c-dd73b9ffdb75 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:03.621160 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 152/299] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:03.627631 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292acce4-1f06-4468-ab9c-dd73b9ffdb75 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:03.632883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46fdc7-d6b9-4327-8f62-facb24960554 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:03.704493 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500e6cf-58c9-40c0-9c78-1978146c3ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:03.706267 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500e6cf-58c9-40c0-9c78-1978146c3ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:03.707229 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500e6cf-58c9-40c0-9c78-1978146c3ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:03.708957 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500e6cf-58c9-40c0-9c78-1978146c3ac5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:03.726408 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:03.732394 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500e6cf-58c9-40c0-9c78-1978146c3ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4500e6cf-58c9-40c0-9c78-1978146c3ac5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:03.754816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:03.755781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:03.756568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:03.756568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:03.756568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:03.756568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:03.756568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:03.756568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:03.756568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:03.756568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:03.756568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:03.756568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:03.756568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:31:03.756568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:03.757821 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 148/300] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:03.759824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb08bec-f4c2-41f6-9b4d-b3e9e217bae8 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:03.760331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb08bec-f4c2-41f6-9b4d-b3e9e217bae8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:03.760820 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb08bec-f4c2-41f6-9b4d-b3e9e217bae8 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:03.763969 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 149/301] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:03.765617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb08bec-f4c2-41f6-9b4d-b3e9e217bae8 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:03.815238 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:03.822918 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292acce4-1f06-4468-ab9c-dd73b9ffdb75 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:03.871344 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecba4a-bb92-49cf-a696-96661953d3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:03.872285 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecba4a-bb92-49cf-a696-96661953d3fd None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:03.872576 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecba4a-bb92-49cf-a696-96661953d3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:03.872846 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecba4a-bb92-49cf-a696-96661953d3fd None admin] PATH_INFO: `/v3/groups` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:03.874455 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecba4a-bb92-49cf-a696-96661953d3fd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:03.875936 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecba4a-bb92-49cf-a696-96661953d3fd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:03.895112 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 153/302] 10.222.0.45 () {60 vars in 1134 bytes} [Wed Jun 15 09:31:03 2022] POST /identity/v3/groups => generated 229 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 09:31:03.897721 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bacea-03c5-47d3-9b90-915028f07d77 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:03.898337 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bacea-03c5-47d3-9b90-915028f07d77 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:03.898890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bacea-03c5-47d3-9b90-915028f07d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:03.918880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb08bec-f4c2-41f6-9b4d-b3e9e217bae8 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:03.925353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d31bacea-03c5-47d3-9b90-915028f07d77 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:03.928256 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d31bacea-03c5-47d3-9b90-915028f07d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:03.981958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e94dd-abfd-4da4-87dc-f832ee32a480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:03.984200 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e94dd-abfd-4da4-87dc-f832ee32a480 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:03.984635 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e94dd-abfd-4da4-87dc-f832ee32a480 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:03.985039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e94dd-abfd-4da4-87dc-f832ee32a480 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:03.986040 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e94dd-abfd-4da4-87dc-f832ee32a480 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:03.986585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e94dd-abfd-4da4-87dc-f832ee32a480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:03.988683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e94dd-abfd-4da4-87dc-f832ee32a480 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:03.999719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 150/303] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:31:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:04.002331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fbe56-8ebd-4567-8e86-8de201b0879f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:04.003070 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fbe56-8ebd-4567-8e86-8de201b0879f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:04.003776 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fbe56-8ebd-4567-8e86-8de201b0879f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:04.006902 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 151/304] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:04.008834 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fbe56-8ebd-4567-8e86-8de201b0879f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:04.036962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 154/305] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:04.038668 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897add58-a2cb-4484-8b52-29fa3348a54b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:04.039348 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897add58-a2cb-4484-8b52-29fa3348a54b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:04.039973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897add58-a2cb-4484-8b52-29fa3348a54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:04.069801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-897add58-a2cb-4484-8b52-29fa3348a54b None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:04.071743 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-897add58-a2cb-4484-8b52-29fa3348a54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:04.106159 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:04.161913 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 155/306] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:04.163845 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897add58-a2cb-4484-8b52-29fa3348a54b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:04.168914 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:04.173072 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fbe56-8ebd-4567-8e86-8de201b0879f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:04.229771 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d1f6f-481c-438f-a8a6-75cc89723e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:04.231474 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1f6f-481c-438f-a8a6-75cc89723e2e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:04.231969 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1f6f-481c-438f-a8a6-75cc89723e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:04.232518 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d1f6f-481c-438f-a8a6-75cc89723e2e None admin] PATH_INFO: `/v3/users/da17ea4952c345b9857bc65dcb2cb9ee` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:04.258129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d1f6f-481c-438f-a8a6-75cc89723e2e None admin] RBAC: Authorizing `identity:get_user(user_id=da17ea4952c345b9857bc65dcb2cb9ee)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:04.260896 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d1f6f-481c-438f-a8a6-75cc89723e2e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:04.264604 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 152/307] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:31:04 2022] GET /identity/v3/users/da17ea4952c345b9857bc65dcb2cb9ee => generated 293 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:04.267976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d1f6f-481c-438f-a8a6-75cc89723e2e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:04.293342 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897add58-a2cb-4484-8b52-29fa3348a54b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:04.333877 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b562a95-e564-4e14-a601-8b083911f349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:04.334723 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b562a95-e564-4e14-a601-8b083911f349 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:04.335178 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b562a95-e564-4e14-a601-8b083911f349 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:04.335634 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b562a95-e564-4e14-a601-8b083911f349 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:04.349985 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b562a95-e564-4e14-a601-8b083911f349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-0b562a95-e564-4e14-a601-8b083911f349 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:04.357991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:04.360020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:04.362231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:04.362231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:04.362231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:04.362231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:04.362231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:04.362231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:04.362231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:04.362231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:04.362231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:04.362231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:04.362231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:04.362231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:04.362231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 156/308] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:04.362231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b562a95-e564-4e14-a601-8b083911f349 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:04.397057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:04.415565 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d1f6f-481c-438f-a8a6-75cc89723e2e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:04.457718 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eaa876-3b0e-47c1-a02f-ec7d8278b03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:04.459037 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eaa876-3b0e-47c1-a02f-ec7d8278b03b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:04.460137 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eaa876-3b0e-47c1-a02f-ec7d8278b03b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:04.460137 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eaa876-3b0e-47c1-a02f-ec7d8278b03b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:04.479132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eaa876-3b0e-47c1-a02f-ec7d8278b03b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:04.492217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b562a95-e564-4e14-a601-8b083911f349 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-57eaa876-3b0e-47c1-a02f-ec7d8278b03b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:04.495180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:04.496259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:04.497179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:04.497179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:04.497179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:04.497179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:04.497179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:04.497179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:04.497179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:04.497179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:04.497179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:04.497179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:04.497179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:31:04.497179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:04.497179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 153/309] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:04.498477 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eaa876-3b0e-47c1-a02f-ec7d8278b03b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:04.526491 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:04.541317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fc7b6-0425-4011-a9bd-f5dbe0be9c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:04.542223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fc7b6-0425-4011-a9bd-f5dbe0be9c71 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:04.542707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fc7b6-0425-4011-a9bd-f5dbe0be9c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:04.543141 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fc7b6-0425-4011-a9bd-f5dbe0be9c71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:04.544366 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fc7b6-0425-4011-a9bd-f5dbe0be9c71 None admin] RBAC: Adding query filter params (role.id=50aac635500847d795e12adf460cbe94, user.id=da17ea4952c345b9857bc65dcb2cb9ee, scope.system=all) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:04.545268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fc7b6-0425-4011-a9bd-f5dbe0be9c71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:04.547054 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fc7b6-0425-4011-a9bd-f5dbe0be9c71 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:04.553753 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 157/310] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Jun 15 09:31:04 2022] GET /identity/v3/role_assignments?user.id=da17ea4952c345b9857bc65dcb2cb9ee&scope.system=all&role.id=50aac635500847d795e12adf460cbe94 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:04.554416 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fc7b6-0425-4011-a9bd-f5dbe0be9c71 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:04.648073 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eaa876-3b0e-47c1-a02f-ec7d8278b03b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:04.673678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fc7b6-0425-4011-a9bd-f5dbe0be9c71 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:04.676351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:04.708727 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb277c4-baa5-43d0-a62f-bfdc0ea2ba7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:04.709807 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb277c4-baa5-43d0-a62f-bfdc0ea2ba7b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:04.710156 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb277c4-baa5-43d0-a62f-bfdc0ea2ba7b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:04.710545 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb277c4-baa5-43d0-a62f-bfdc0ea2ba7b None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:04.711923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb277c4-baa5-43d0-a62f-bfdc0ea2ba7b None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:04.712562 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb277c4-baa5-43d0-a62f-bfdc0ea2ba7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:04.714339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb277c4-baa5-43d0-a62f-bfdc0ea2ba7b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:04.725663 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 154/311] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:31:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:04.727465 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa378c52-60a0-497e-a77b-2fa7f467bc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:04.728305 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa378c52-60a0-497e-a77b-2fa7f467bc0a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:04.728797 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa378c52-60a0-497e-a77b-2fa7f467bc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:04.729201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa378c52-60a0-497e-a77b-2fa7f467bc0a None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:04.730145 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa378c52-60a0-497e-a77b-2fa7f467bc0a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:04.730641 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa378c52-60a0-497e-a77b-2fa7f467bc0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:04.731492 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb277c4-baa5-43d0-a62f-bfdc0ea2ba7b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:04.732592 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa378c52-60a0-497e-a77b-2fa7f467bc0a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:04.745874 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 158/312] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:31:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:04.752502 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa378c52-60a0-497e-a77b-2fa7f467bc0a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:04.866698 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:04.876487 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa378c52-60a0-497e-a77b-2fa7f467bc0a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:04.906730 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb277c4-baa5-43d0-a62f-bfdc0ea2ba7b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:04.941246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360413c6-508f-45c8-a42e-54744a9037c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:04.943302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360413c6-508f-45c8-a42e-54744a9037c2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:04.943816 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360413c6-508f-45c8-a42e-54744a9037c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:04.944739 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360413c6-508f-45c8-a42e-54744a9037c2 None admin] PATH_INFO: `/v3/users/c3ee68e0d6ad4d8b9af6d849abde0d8e` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:04.947433 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360413c6-508f-45c8-a42e-54744a9037c2 None admin] RBAC: Authorizing `identity:get_user(user_id=c3ee68e0d6ad4d8b9af6d849abde0d8e)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:04.949889 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee4832-3b07-4844-8429-bbdf5477661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:04.950385 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360413c6-508f-45c8-a42e-54744a9037c2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:04.951968 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee4832-3b07-4844-8429-bbdf5477661a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:04.952450 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee4832-3b07-4844-8429-bbdf5477661a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:04.952952 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee4832-3b07-4844-8429-bbdf5477661a None admin] PATH_INFO: `/v3/users/b9a72c2673ea4a0c8a8bfb5899bb8b21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:04.954396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee4832-3b07-4844-8429-bbdf5477661a None admin] RBAC: Authorizing `identity:get_user(user_id=b9a72c2673ea4a0c8a8bfb5899bb8b21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:04.954612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 159/313] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:31:04 2022] GET /identity/v3/users/c3ee68e0d6ad4d8b9af6d849abde0d8e => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:04.956339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee4832-3b07-4844-8429-bbdf5477661a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:04.958309 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 155/314] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:31:04 2022] GET /identity/v3/users/b9a72c2673ea4a0c8a8bfb5899bb8b21 => generated 293 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:04.960773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360413c6-508f-45c8-a42e-54744a9037c2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:04.963731 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee4832-3b07-4844-8429-bbdf5477661a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:05.014263 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:05.142336 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360413c6-508f-45c8-a42e-54744a9037c2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:05.144369 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee4832-3b07-4844-8429-bbdf5477661a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:05.188678 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7481301-a554-4a46-ad08-976c41929160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:05.189614 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7481301-a554-4a46-ad08-976c41929160 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:05.189614 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7481301-a554-4a46-ad08-976c41929160 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:05.189614 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7481301-a554-4a46-ad08-976c41929160 None admin] PATH_INFO: `/v3/system/users/b9a72c2673ea4a0c8a8bfb5899bb8b21/roles/edcc1e17fab74f2d93941e3c37b66546` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:05.191106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7481301-a554-4a46-ad08-976c41929160 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b9a72c2673ea4a0c8a8bfb5899bb8b21, role_id=edcc1e17fab74f2d93941e3c37b66546)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:05.192702 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7481301-a554-4a46-ad08-976c41929160 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:05.206311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 156/315] 10.222.0.45 () {58 vars in 1334 bytes} [Wed Jun 15 09:31:04 2022] PUT /identity/v3/system/users/b9a72c2673ea4a0c8a8bfb5899bb8b21/roles/edcc1e17fab74f2d93941e3c37b66546 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 09:31:05.219398 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24318cd-e83c-4aab-aa6b-a8371aa25727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:05.220156 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24318cd-e83c-4aab-aa6b-a8371aa25727 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:05.220454 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24318cd-e83c-4aab-aa6b-a8371aa25727 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:05.220739 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24318cd-e83c-4aab-aa6b-a8371aa25727 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:05.308009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24318cd-e83c-4aab-aa6b-a8371aa25727 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:05.309609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24318cd-e83c-4aab-aa6b-a8371aa25727 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:05.338381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:05.434417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 160/316] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 09:31:05.440633 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7481301-a554-4a46-ad08-976c41929160 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:05.453227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:05.569279 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7481301-a554-4a46-ad08-976c41929160 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:05.609099 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1703f9-e9a5-4df2-b3bd-3fd7af0fe76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:05.609978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1703f9-e9a5-4df2-b3bd-3fd7af0fe76f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:05.610270 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1703f9-e9a5-4df2-b3bd-3fd7af0fe76f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:05.610581 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1703f9-e9a5-4df2-b3bd-3fd7af0fe76f None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:05.611872 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1703f9-e9a5-4df2-b3bd-3fd7af0fe76f None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:05.613352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1703f9-e9a5-4df2-b3bd-3fd7af0fe76f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:05.615563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 157/317] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:05 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:05.621991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24318cd-e83c-4aab-aa6b-a8371aa25727 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:05.758408 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24318cd-e83c-4aab-aa6b-a8371aa25727 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:05.797410 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:05.802817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedccc50-bcd5-40c6-9ea3-c576504f835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:05.803507 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedccc50-bcd5-40c6-9ea3-c576504f835f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:05.803944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedccc50-bcd5-40c6-9ea3-c576504f835f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:05.804225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedccc50-bcd5-40c6-9ea3-c576504f835f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:05.805081 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedccc50-bcd5-40c6-9ea3-c576504f835f None admin] RBAC: Adding query filter params (role.id=50aac635500847d795e12adf460cbe94, scope.project.id=553fd0a11f484754beb16edeccbddc21, user.id=c3ee68e0d6ad4d8b9af6d849abde0d8e) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:05.805471 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedccc50-bcd5-40c6-9ea3-c576504f835f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:05.807091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedccc50-bcd5-40c6-9ea3-c576504f835f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:05.814565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 161/318] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:31:05 2022] GET /identity/v3/role_assignments?user.id=c3ee68e0d6ad4d8b9af6d849abde0d8e&scope.project.id=553fd0a11f484754beb16edeccbddc21&role.id=50aac635500847d795e12adf460cbe94 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:07.018618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232aad61-7b77-4a97-a929-b2f1ebeb533a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:07.019291 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232aad61-7b77-4a97-a929-b2f1ebeb533a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:07.019291 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232aad61-7b77-4a97-a929-b2f1ebeb533a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:07.020849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 158/319] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:07.027325 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f61346-d3e8-4679-8a7c-5b29f8087587 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:07.027782 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f61346-d3e8-4679-8a7c-5b29f8087587 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:07.027880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f61346-d3e8-4679-8a7c-5b29f8087587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:07.046898 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-51f61346-d3e8-4679-8a7c-5b29f8087587 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:07.048424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-51f61346-d3e8-4679-8a7c-5b29f8087587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:07.125520 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb935be-2987-45c1-949a-7ed4915abe70 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:07.125812 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb935be-2987-45c1-949a-7ed4915abe70 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:07.126321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb935be-2987-45c1-949a-7ed4915abe70 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:07.127919 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 159/320] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:07.129961 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 162/321] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:31:07.136250 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9df853-1e1d-48ed-8bf8-81cd5861d238 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:07.136558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9df853-1e1d-48ed-8bf8-81cd5861d238 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:07.136810 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9df853-1e1d-48ed-8bf8-81cd5861d238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:07.154754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f61346-d3e8-4679-8a7c-5b29f8087587 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:07.155289 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bd9df853-1e1d-48ed-8bf8-81cd5861d238 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:07.156500 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bd9df853-1e1d-48ed-8bf8-81cd5861d238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:07.238766 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 160/322] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:31:07.272124 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f61346-d3e8-4679-8a7c-5b29f8087587 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:07.279882 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9df853-1e1d-48ed-8bf8-81cd5861d238 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:07.289189 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:07.290561 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:07.314044 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f5e29-435a-4441-b7d5-18f3480f0d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:07.315563 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f5e29-435a-4441-b7d5-18f3480f0d3c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:07.316078 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f5e29-435a-4441-b7d5-18f3480f0d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:07.316831 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f5e29-435a-4441-b7d5-18f3480f0d3c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:07.333370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f5e29-435a-4441-b7d5-18f3480f0d3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-4c0f5e29-435a-4441-b7d5-18f3480f0d3c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:07.342528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:07.343544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:07.344565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:07.344565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:07.344565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:07.344565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:07.344565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:07.344565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:07.344565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:07.344565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:07.344565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:07.344565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:07.344565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:31:07.344565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:07.344565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 163/323] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:07.355582 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f5e29-435a-4441-b7d5-18f3480f0d3c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:07.443243 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9df853-1e1d-48ed-8bf8-81cd5861d238 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:07.482908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f5e29-435a-4441-b7d5-18f3480f0d3c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:07.501927 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2eed2-61fe-457c-8785-2d03bcc91b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:07.502779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2eed2-61fe-457c-8785-2d03bcc91b8b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:07.503059 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2eed2-61fe-457c-8785-2d03bcc91b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:07.503330 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2eed2-61fe-457c-8785-2d03bcc91b8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:07.504542 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2eed2-61fe-457c-8785-2d03bcc91b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:07.505997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2eed2-61fe-457c-8785-2d03bcc91b8b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:07.507869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 161/324] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:07.513202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2eed2-61fe-457c-8785-2d03bcc91b8b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:07.532938 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b00672-1a25-48c0-9d13-99ec3f039315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:07.533538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b00672-1a25-48c0-9d13-99ec3f039315 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:07.533818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b00672-1a25-48c0-9d13-99ec3f039315 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:07.534098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b00672-1a25-48c0-9d13-99ec3f039315 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:07.534907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b00672-1a25-48c0-9d13-99ec3f039315 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:07.535221 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b00672-1a25-48c0-9d13-99ec3f039315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:07.536620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b00672-1a25-48c0-9d13-99ec3f039315 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:07.547132 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 164/325] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:31:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:07.548482 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed86f58-93de-4f18-92c6-11db3daab832 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:07.548865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed86f58-93de-4f18-92c6-11db3daab832 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:07.549085 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed86f58-93de-4f18-92c6-11db3daab832 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:07.550527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 165/326] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:07.552750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed86f58-93de-4f18-92c6-11db3daab832 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:07.596457 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:07.609592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:07.636934 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2eed2-61fe-457c-8785-2d03bcc91b8b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:07.673333 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed86f58-93de-4f18-92c6-11db3daab832 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:07.674578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c610fdd-2cc1-4ca4-83b4-74163ac8ae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:07.675227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c610fdd-2cc1-4ca4-83b4-74163ac8ae8a None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:07.675538 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c610fdd-2cc1-4ca4-83b4-74163ac8ae8a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:07.675797 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c610fdd-2cc1-4ca4-83b4-74163ac8ae8a None admin] PATH_INFO: `/v3/groups` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:07.676496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c610fdd-2cc1-4ca4-83b4-74163ac8ae8a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:07.677950 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c610fdd-2cc1-4ca4-83b4-74163ac8ae8a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:07.696445 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 162/327] 10.222.0.45 () {60 vars in 1134 bytes} [Wed Jun 15 09:31:07 2022] POST /identity/v3/groups => generated 226 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 09:31:07.697851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc4d5-de26-457c-a1e8-4ac171ece646 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:07.698240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc4d5-de26-457c-a1e8-4ac171ece646 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:07.698548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc4d5-de26-457c-a1e8-4ac171ece646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:07.721193 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-790fc4d5-de26-457c-a1e8-4ac171ece646 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:07.723490 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-790fc4d5-de26-457c-a1e8-4ac171ece646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:07.725757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2b964-b288-4e05-87d0-942421f15beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:07.726768 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2b964-b288-4e05-87d0-942421f15beb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:07.727227 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2b964-b288-4e05-87d0-942421f15beb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:07.727364 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2b964-b288-4e05-87d0-942421f15beb None admin] PATH_INFO: `/v3/users/da17ea4952c345b9857bc65dcb2cb9ee` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:07.728641 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2b964-b288-4e05-87d0-942421f15beb None admin] RBAC: Authorizing `identity:get_user(user_id=da17ea4952c345b9857bc65dcb2cb9ee)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:07.730137 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2b964-b288-4e05-87d0-942421f15beb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:07.732152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 166/328] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:31:07 2022] GET /identity/v3/users/da17ea4952c345b9857bc65dcb2cb9ee => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:07.737915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2b964-b288-4e05-87d0-942421f15beb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:07.823855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 163/329] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:07.847985 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fc4d5-de26-457c-a1e8-4ac171ece646 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:07.894792 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2b964-b288-4e05-87d0-942421f15beb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:07.898550 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:07.927786 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:07.957457 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6474f42-8bc8-466c-bc67-2e4e464ce36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:07.958870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474f42-8bc8-466c-bc67-2e4e464ce36c None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:07.959314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474f42-8bc8-466c-bc67-2e4e464ce36c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:07.959760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474f42-8bc8-466c-bc67-2e4e464ce36c None admin] PATH_INFO: `/v3/system/users/da17ea4952c345b9857bc65dcb2cb9ee/roles/50aac635500847d795e12adf460cbe94` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:07.961626 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6474f42-8bc8-466c-bc67-2e4e464ce36c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=da17ea4952c345b9857bc65dcb2cb9ee, role_id=50aac635500847d795e12adf460cbe94)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:07.964254 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6474f42-8bc8-466c-bc67-2e4e464ce36c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:07.979812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 167/330] 10.222.0.45 () {58 vars in 1334 bytes} [Wed Jun 15 09:31:07 2022] PUT /identity/v3/system/users/da17ea4952c345b9857bc65dcb2cb9ee/roles/50aac635500847d795e12adf460cbe94 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 09:31:07.985093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fc4d5-de26-457c-a1e8-4ac171ece646 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:08.048118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e44ae9-f2ac-49f2-a11c-62c84cbdc799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:08.049529 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e44ae9-f2ac-49f2-a11c-62c84cbdc799 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:08.050078 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e44ae9-f2ac-49f2-a11c-62c84cbdc799 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:08.050592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e44ae9-f2ac-49f2-a11c-62c84cbdc799 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:08.069283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e44ae9-f2ac-49f2-a11c-62c84cbdc799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-25e44ae9-f2ac-49f2-a11c-62c84cbdc799 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:08.083126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:08.084849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:08.086780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:08.086780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:08.086780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:08.086780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:08.086780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:08.086780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:08.086780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:08.086780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:08.086780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:08.086780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:08.086780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:08.086780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:08.086780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 164/331] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:08.094912 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6474f42-8bc8-466c-bc67-2e4e464ce36c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:08.294174 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6474f42-8bc8-466c-bc67-2e4e464ce36c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:08.364561 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5825c4-9552-4a9f-a1a6-af96761fa808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:08.365534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5825c4-9552-4a9f-a1a6-af96761fa808 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:08.365970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5825c4-9552-4a9f-a1a6-af96761fa808 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:08.366396 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5825c4-9552-4a9f-a1a6-af96761fa808 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:08.367682 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5825c4-9552-4a9f-a1a6-af96761fa808 None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:08.368422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5825c4-9552-4a9f-a1a6-af96761fa808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:08.370525 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5825c4-9552-4a9f-a1a6-af96761fa808 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:08.391144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 168/332] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:31:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:08.396854 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e44ae9-f2ac-49f2-a11c-62c84cbdc799 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:08.577008 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e44ae9-f2ac-49f2-a11c-62c84cbdc799 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:08.620461 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:08.643106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b44b2-8442-4733-b673-20725d9a13fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:08.644622 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b44b2-8442-4733-b673-20725d9a13fb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:08.645378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b44b2-8442-4733-b673-20725d9a13fb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:08.645860 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b44b2-8442-4733-b673-20725d9a13fb None admin] PATH_INFO: `/v3/users/b9a72c2673ea4a0c8a8bfb5899bb8b21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:08.650198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b44b2-8442-4733-b673-20725d9a13fb None admin] RBAC: Authorizing `identity:get_user(user_id=b9a72c2673ea4a0c8a8bfb5899bb8b21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:08.651835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b44b2-8442-4733-b673-20725d9a13fb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:08.654767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 165/333] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:31:08 2022] GET /identity/v3/users/b9a72c2673ea4a0c8a8bfb5899bb8b21 => generated 293 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:08.664326 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5825c4-9552-4a9f-a1a6-af96761fa808 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:08.738063 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:08.921588 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5825c4-9552-4a9f-a1a6-af96761fa808 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:08.991650 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd105ff-8a72-4c70-97ef-de2610020479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:08.992814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd105ff-8a72-4c70-97ef-de2610020479 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:08.993320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd105ff-8a72-4c70-97ef-de2610020479 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:08.993817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd105ff-8a72-4c70-97ef-de2610020479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:08.995441 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd105ff-8a72-4c70-97ef-de2610020479 None admin] RBAC: Adding query filter params (role.id=edcc1e17fab74f2d93941e3c37b66546, user.id=b9a72c2673ea4a0c8a8bfb5899bb8b21, scope.system=all) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:08.995985 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd105ff-8a72-4c70-97ef-de2610020479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:08.998890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd105ff-8a72-4c70-97ef-de2610020479 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:09.026371 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 169/334] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Jun 15 09:31:08 2022] GET /identity/v3/role_assignments?user.id=b9a72c2673ea4a0c8a8bfb5899bb8b21&scope.system=all&role.id=edcc1e17fab74f2d93941e3c37b66546 => generated 510 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:10.298150 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52434d-2e23-4532-be8d-e087caf9c0df None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:10.298695 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52434d-2e23-4532-be8d-e087caf9c0df None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:10.298817 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52434d-2e23-4532-be8d-e087caf9c0df None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:10.300402 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 166/335] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:10.307338 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71deac-6069-4c02-8620-77b46585fd25 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:10.307853 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71deac-6069-4c02-8620-77b46585fd25 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:10.308348 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71deac-6069-4c02-8620-77b46585fd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:10.348242 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7c71deac-6069-4c02-8620-77b46585fd25 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:10.350220 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7c71deac-6069-4c02-8620-77b46585fd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:10.503853 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 170/336] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:10.584860 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c4079-410f-44c7-983c-ff921258d248 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:10.585483 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c4079-410f-44c7-983c-ff921258d248 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:10.585979 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c4079-410f-44c7-983c-ff921258d248 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:10.587914 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 167/337] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:10.591930 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71deac-6069-4c02-8620-77b46585fd25 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:10.595786 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2790d-581f-4e86-8f31-13587f30be94 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:10.596623 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2790d-581f-4e86-8f31-13587f30be94 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:10.597378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2790d-581f-4e86-8f31-13587f30be94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:10.664664 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a3a2790d-581f-4e86-8f31-13587f30be94 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:10.669123 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a3a2790d-581f-4e86-8f31-13587f30be94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:10.671711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:10.920540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 168/338] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:10.924401 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71deac-6069-4c02-8620-77b46585fd25 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:10.964848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2790d-581f-4e86-8f31-13587f30be94 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:11.016177 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d790db-9cb5-4daa-abef-a7aebe2ce971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:11.017903 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d790db-9cb5-4daa-abef-a7aebe2ce971 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:11.018813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d790db-9cb5-4daa-abef-a7aebe2ce971 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:11.019997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d790db-9cb5-4daa-abef-a7aebe2ce971 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:11.048901 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d790db-9cb5-4daa-abef-a7aebe2ce971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-34d790db-9cb5-4daa-abef-a7aebe2ce971 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:11.068091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:11.069661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:11.071201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:11.071201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:11.071201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:11.071201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:11.071201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:11.071201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:11.071201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:11.071201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:11.071201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:11.071201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:11.071201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:11.071201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:11.078689 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 171/339] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 488 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:11.089129 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d790db-9cb5-4daa-abef-a7aebe2ce971 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:11.151787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2790d-581f-4e86-8f31-13587f30be94 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:11.179061 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:11.212799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac465a2-222e-4f0b-b3b9-838c83d28c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:11.214489 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac465a2-222e-4f0b-b3b9-838c83d28c45 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:11.219447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac465a2-222e-4f0b-b3b9-838c83d28c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:11.220155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac465a2-222e-4f0b-b3b9-838c83d28c45 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:11.251146 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac465a2-222e-4f0b-b3b9-838c83d28c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0ac465a2-222e-4f0b-b3b9-838c83d28c45 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:11.259406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:11.261331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:11.263869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:11.263869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:11.263869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:11.263869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:11.263869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:11.263869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:11.263869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:11.263869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:11.263869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:11.263869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:11.263869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 09:31:11.263869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:11.263869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 169/340] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:11.268933 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac465a2-222e-4f0b-b3b9-838c83d28c45 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:11.334570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:11.389283 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d790db-9cb5-4daa-abef-a7aebe2ce971 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:11.476630 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b3e03-85c6-410e-8aaa-a9a39ef1d2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:11.477717 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b3e03-85c6-410e-8aaa-a9a39ef1d2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:11.478357 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b3e03-85c6-410e-8aaa-a9a39ef1d2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:11.478884 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b3e03-85c6-410e-8aaa-a9a39ef1d2c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:11.480299 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b3e03-85c6-410e-8aaa-a9a39ef1d2c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:11.480845 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b3e03-85c6-410e-8aaa-a9a39ef1d2c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:11.483815 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b3e03-85c6-410e-8aaa-a9a39ef1d2c2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:11.495582 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac465a2-222e-4f0b-b3b9-838c83d28c45 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:11.514545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 172/341] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:31:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:11.534538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b3e03-85c6-410e-8aaa-a9a39ef1d2c2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:11.563856 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db40d6-3fa2-401e-821a-3379f8f6179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:11.564546 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db40d6-3fa2-401e-821a-3379f8f6179f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:11.564827 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db40d6-3fa2-401e-821a-3379f8f6179f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:11.565102 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db40d6-3fa2-401e-821a-3379f8f6179f None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:11.565869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db40d6-3fa2-401e-821a-3379f8f6179f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:11.566176 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db40d6-3fa2-401e-821a-3379f8f6179f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:11.567620 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db40d6-3fa2-401e-821a-3379f8f6179f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:11.577824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 170/342] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:31:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:11.583527 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db40d6-3fa2-401e-821a-3379f8f6179f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:11.649056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:11.736951 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db40d6-3fa2-401e-821a-3379f8f6179f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:11.804320 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ee98a-47df-40d4-9bdf-2a6d02deeb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:11.805221 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee98a-47df-40d4-9bdf-2a6d02deeb82 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:11.805502 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee98a-47df-40d4-9bdf-2a6d02deeb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:11.805786 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ee98a-47df-40d4-9bdf-2a6d02deeb82 None admin] PATH_INFO: `/v3/users/da17ea4952c345b9857bc65dcb2cb9ee` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:11.807207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ee98a-47df-40d4-9bdf-2a6d02deeb82 None admin] RBAC: Authorizing `identity:get_user(user_id=da17ea4952c345b9857bc65dcb2cb9ee)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:11.810530 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ee98a-47df-40d4-9bdf-2a6d02deeb82 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:11.811107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 171/343] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:31:11 2022] GET /identity/v3/users/da17ea4952c345b9857bc65dcb2cb9ee => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:11.816926 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ee98a-47df-40d4-9bdf-2a6d02deeb82 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:11.848951 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b3e03-85c6-410e-8aaa-a9a39ef1d2c2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:11.980507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ee98a-47df-40d4-9bdf-2a6d02deeb82 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:11.983566 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b6222-2c16-4f18-9ee0-9d52b4d853c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:11.985054 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b6222-2c16-4f18-9ee0-9d52b4d853c2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:11.985826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b6222-2c16-4f18-9ee0-9d52b4d853c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:11.986623 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b6222-2c16-4f18-9ee0-9d52b4d853c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:12.016614 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:12.019031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:12.034156 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5beba-c313-45f9-93ad-9bb5268050ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:12.034859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5beba-c313-45f9-93ad-9bb5268050ce None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:12.035146 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5beba-c313-45f9-93ad-9bb5268050ce None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:12.035425 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5beba-c313-45f9-93ad-9bb5268050ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:12.036276 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5beba-c313-45f9-93ad-9bb5268050ce None admin] RBAC: Adding query filter params (role.id=50aac635500847d795e12adf460cbe94, user.id=da17ea4952c345b9857bc65dcb2cb9ee, scope.system=all) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:12.036588 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5beba-c313-45f9-93ad-9bb5268050ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:12.038049 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5beba-c313-45f9-93ad-9bb5268050ce None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:12.058548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 172/344] 10.222.0.45 () {56 vars in 1308 bytes} [Wed Jun 15 09:31:11 2022] GET /identity/v3/role_assignments?user.id=da17ea4952c345b9857bc65dcb2cb9ee&scope.system=all&role.id=50aac635500847d795e12adf460cbe94 => generated 510 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:12.191926 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b6222-2c16-4f18-9ee0-9d52b4d853c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:12.195403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b6222-2c16-4f18-9ee0-9d52b4d853c2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:12.416741 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bcc20-3879-4807-815f-8d85b9507626 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:12.416988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bcc20-3879-4807-815f-8d85b9507626 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:12.417199 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bcc20-3879-4807-815f-8d85b9507626 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:12.422533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 173/346] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:12.422846 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 173/346] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 887 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:12.428722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bcc20-3879-4807-815f-8d85b9507626 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:12.431934 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed3f7a-ff9b-4d7d-b303-e9fea90a3582 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:12.432789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed3f7a-ff9b-4d7d-b303-e9fea90a3582 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:12.433497 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed3f7a-ff9b-4d7d-b303-e9fea90a3582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:12.480362 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-49ed3f7a-ff9b-4d7d-b303-e9fea90a3582 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:12.483347 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-49ed3f7a-ff9b-4d7d-b303-e9fea90a3582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:12.599414 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:12.679057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 174/347] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:12.727029 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bcc20-3879-4807-815f-8d85b9507626 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:12.816398 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed3f7a-ff9b-4d7d-b303-e9fea90a3582 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:12.822534 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06175e6-f556-4aba-8471-69ff6c4dc2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:12.822534 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06175e6-f556-4aba-8471-69ff6c4dc2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:12.822534 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06175e6-f556-4aba-8471-69ff6c4dc2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:12.822534 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06175e6-f556-4aba-8471-69ff6c4dc2f0 None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:12.824643 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06175e6-f556-4aba-8471-69ff6c4dc2f0 None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:12.829369 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06175e6-f556-4aba-8471-69ff6c4dc2f0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:12.838557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 174/348] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:12 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:12.849537 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06175e6-f556-4aba-8471-69ff6c4dc2f0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:12.981624 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:13.096577 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed3f7a-ff9b-4d7d-b303-e9fea90a3582 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:13.120755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06175e6-f556-4aba-8471-69ff6c4dc2f0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:13.161072 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4820ec5-2f12-47f2-8178-d837bb0307e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:13.162842 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820ec5-2f12-47f2-8178-d837bb0307e4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:13.163508 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820ec5-2f12-47f2-8178-d837bb0307e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:13.164221 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4820ec5-2f12-47f2-8178-d837bb0307e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:13.164555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af3569-6bef-4df4-aeaa-477b33c82165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:13.165677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af3569-6bef-4df4-aeaa-477b33c82165 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:13.166174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af3569-6bef-4df4-aeaa-477b33c82165 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:13.166685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af3569-6bef-4df4-aeaa-477b33c82165 None admin] PATH_INFO: `/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:13.174170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af3569-6bef-4df4-aeaa-477b33c82165 None admin] RBAC: Authorizing `identity:get_group(group_id=79c67a324e2d42ddaf8761bd1556bdd5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:13.176135 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af3569-6bef-4df4-aeaa-477b33c82165 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:13.178382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 175/349] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Jun 15 09:31:12 2022] GET /identity/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5 => generated 226 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:13.180156 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c90836-bb9c-4566-b3cf-95eba9481c8c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:13.180448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c90836-bb9c-4566-b3cf-95eba9481c8c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:13.180856 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c90836-bb9c-4566-b3cf-95eba9481c8c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:13.182718 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 176/350] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:13.184248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f87e71-1c90-4959-a756-fe4c4dc1856e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:13.185123 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f87e71-1c90-4959-a756-fe4c4dc1856e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:13.185469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f87e71-1c90-4959-a756-fe4c4dc1856e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:13.187245 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 177/351] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:13.188583 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e31da-89e4-4d10-bfc7-e19859bb9662 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:13.189024 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e31da-89e4-4d10-bfc7-e19859bb9662 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:13.189519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e31da-89e4-4d10-bfc7-e19859bb9662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:13.190702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4820ec5-2f12-47f2-8178-d837bb0307e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f4820ec5-2f12-47f2-8178-d837bb0307e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:13.209247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:13.211104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:13.212750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:13.212750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:13.212750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:13.212750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:13.212750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:13.212750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:13.212750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:13.212750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:13.212750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:13.212750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:13.212750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:31:13.212750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:13.216947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 175/352] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:31:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:13.218905 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4820ec5-2f12-47f2-8178-d837bb0307e4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:13.226033 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-139e31da-89e4-4d10-bfc7-e19859bb9662 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:13.229657 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-139e31da-89e4-4d10-bfc7-e19859bb9662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:13.283440 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:13.336251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 178/353] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:13.338351 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93afb7-6c5c-420b-b983-7416a86a6727 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:13.339026 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93afb7-6c5c-420b-b983-7416a86a6727 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:13.339538 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93afb7-6c5c-420b-b983-7416a86a6727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:13.364855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ec93afb7-6c5c-420b-b983-7416a86a6727 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:13.366415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ec93afb7-6c5c-420b-b983-7416a86a6727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:13.402395 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:13.429750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4820ec5-2f12-47f2-8178-d837bb0307e4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:13.458151 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 179/354] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:13.459182 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93afb7-6c5c-420b-b983-7416a86a6727 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:13.526826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442a5ad-ff63-464e-885f-64d1ed5f2b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:13.528563 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442a5ad-ff63-464e-885f-64d1ed5f2b23 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:13.529548 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442a5ad-ff63-464e-885f-64d1ed5f2b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:13.531916 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442a5ad-ff63-464e-885f-64d1ed5f2b23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:13.532513 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442a5ad-ff63-464e-885f-64d1ed5f2b23 None admin] RBAC: Adding query filter params (group.id=79c67a324e2d42ddaf8761bd1556bdd5, role.id=edcc1e17fab74f2d93941e3c37b66546, scope.project.id=50c4a61b8f494e029afaea135bfd4777) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:13.533182 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442a5ad-ff63-464e-885f-64d1ed5f2b23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:13.537282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442a5ad-ff63-464e-885f-64d1ed5f2b23 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:13.566558 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 176/355] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Jun 15 09:31:13 2022] GET /identity/v3/role_assignments?group.id=79c67a324e2d42ddaf8761bd1556bdd5&scope.project.id=50c4a61b8f494e029afaea135bfd4777&role.id=edcc1e17fab74f2d93941e3c37b66546 => generated 260 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:13.568716 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442a5ad-ff63-464e-885f-64d1ed5f2b23 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:13.596075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93afb7-6c5c-420b-b983-7416a86a6727 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:13.651514 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c8c6e-ebc3-4ed3-87bf-2e081c14daa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:13.652569 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c8c6e-ebc3-4ed3-87bf-2e081c14daa1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:13.653007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c8c6e-ebc3-4ed3-87bf-2e081c14daa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:13.653490 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c8c6e-ebc3-4ed3-87bf-2e081c14daa1 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:13.654445 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c8c6e-ebc3-4ed3-87bf-2e081c14daa1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:13.654979 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c8c6e-ebc3-4ed3-87bf-2e081c14daa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:13.658277 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c8c6e-ebc3-4ed3-87bf-2e081c14daa1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:13.669817 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 180/356] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:13.671163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c8c6e-ebc3-4ed3-87bf-2e081c14daa1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:13.718964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:13.797346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:13.811278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442a5ad-ff63-464e-885f-64d1ed5f2b23 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:13.847465 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c8c6e-ebc3-4ed3-87bf-2e081c14daa1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:13.867467 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ce3bb-8d98-4398-99a9-19feaa0385d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:13.868642 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ce3bb-8d98-4398-99a9-19feaa0385d7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:13.868955 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ce3bb-8d98-4398-99a9-19feaa0385d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:13.869245 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ce3bb-8d98-4398-99a9-19feaa0385d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:13.886954 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ce3bb-8d98-4398-99a9-19feaa0385d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:13.904211 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf347eb-242d-4f61-8a31-6bd201726d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-d20ce3bb-8d98-4398-99a9-19feaa0385d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:13.904701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:13.905560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:13.906370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:13.906370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:13.906370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:13.906370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:13.906370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:13.906370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:13.906370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:13.906370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:13.906370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:13.906370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:13.906370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:31:13.906370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:13.907043 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 177/357] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:31:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:13.908521 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ce3bb-8d98-4398-99a9-19feaa0385d7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:13.908956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf347eb-242d-4f61-8a31-6bd201726d61 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:13.909446 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf347eb-242d-4f61-8a31-6bd201726d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:13.909933 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf347eb-242d-4f61-8a31-6bd201726d61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:13.928535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf347eb-242d-4f61-8a31-6bd201726d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-fbf347eb-242d-4f61-8a31-6bd201726d61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:13.940035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:13.940993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:13.941802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:13.941802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:13.941802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:13.941802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:13.941802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:13.941802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:13.941802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:13.941802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:13.941802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:13.941802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:13.941802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:13.941802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:13.943976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 181/358] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:13.945337 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7647ad-e0e8-40e4-9a83-a20ddb1d3077 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:13.945626 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7647ad-e0e8-40e4-9a83-a20ddb1d3077 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:13.945909 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7647ad-e0e8-40e4-9a83-a20ddb1d3077 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:13.947267 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 182/359] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:13.948180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7647ad-e0e8-40e4-9a83-a20ddb1d3077 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:14.088527 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:14.098254 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ce3bb-8d98-4398-99a9-19feaa0385d7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:14.123336 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7647ad-e0e8-40e4-9a83-a20ddb1d3077 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:14.166607 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318b818-9307-40e9-8eef-f6a8aef6ff56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:14.167571 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318b818-9307-40e9-8eef-f6a8aef6ff56 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:14.167861 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318b818-9307-40e9-8eef-f6a8aef6ff56 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:14.168183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318b818-9307-40e9-8eef-f6a8aef6ff56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:14.180402 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317081b-5461-4f2f-b7bf-d8171679dc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:14.181746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317081b-5461-4f2f-b7bf-d8171679dc35 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:14.182033 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317081b-5461-4f2f-b7bf-d8171679dc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:14.182321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317081b-5461-4f2f-b7bf-d8171679dc35 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:14.183585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317081b-5461-4f2f-b7bf-d8171679dc35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:14.183902 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317081b-5461-4f2f-b7bf-d8171679dc35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:14.185921 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317081b-5461-4f2f-b7bf-d8171679dc35 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:14.197932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 183/360] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:14.198959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317081b-5461-4f2f-b7bf-d8171679dc35 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:14.211202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:14.274703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318b818-9307-40e9-8eef-f6a8aef6ff56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:14.276621 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318b818-9307-40e9-8eef-f6a8aef6ff56 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:14.354746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317081b-5461-4f2f-b7bf-d8171679dc35 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:14.411927 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f0560-dd93-4f02-b5bf-f1222416adbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:14.412620 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f0560-dd93-4f02-b5bf-f1222416adbb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:14.413058 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f0560-dd93-4f02-b5bf-f1222416adbb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:14.413352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f0560-dd93-4f02-b5bf-f1222416adbb None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:14.414128 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f0560-dd93-4f02-b5bf-f1222416adbb None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:14.415528 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f0560-dd93-4f02-b5bf-f1222416adbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:14.416348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f0560-dd93-4f02-b5bf-f1222416adbb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:14.421977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 178/361] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:14.425363 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cead977-095d-451b-8e70-3177499d216d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:14.425994 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 184/362] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:31:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:14.426587 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cead977-095d-451b-8e70-3177499d216d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:14.426989 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f0560-dd93-4f02-b5bf-f1222416adbb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:14.427616 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cead977-095d-451b-8e70-3177499d216d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:14.439951 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:14.452233 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7cead977-095d-451b-8e70-3177499d216d None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:14.454463 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7cead977-095d-451b-8e70-3177499d216d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:14.549141 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:14.583991 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f0560-dd93-4f02-b5bf-f1222416adbb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:14.584842 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 179/363] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:14.588489 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cead977-095d-451b-8e70-3177499d216d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:14.636015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a3638-a887-45d0-96ed-2e593eddd1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:14.638168 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a3638-a887-45d0-96ed-2e593eddd1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:14.639107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a3638-a887-45d0-96ed-2e593eddd1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:14.639801 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a3638-a887-45d0-96ed-2e593eddd1d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:14.753612 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a3638-a887-45d0-96ed-2e593eddd1d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:14.755387 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a3638-a887-45d0-96ed-2e593eddd1d6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:14.756034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cead977-095d-451b-8e70-3177499d216d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:14.766558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:14.825480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe31fe3-689b-45c0-88c1-1726a35ee5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:14.826182 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe31fe3-689b-45c0-88c1-1726a35ee5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:14.826469 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe31fe3-689b-45c0-88c1-1726a35ee5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:14.826779 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe31fe3-689b-45c0-88c1-1726a35ee5a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:14.898903 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 185/364] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:14.900537 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a3638-a887-45d0-96ed-2e593eddd1d6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:14.925213 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:14.948145 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe31fe3-689b-45c0-88c1-1726a35ee5a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:14.950139 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe31fe3-689b-45c0-88c1-1726a35ee5a3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:15.093928 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a3638-a887-45d0-96ed-2e593eddd1d6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:15.115101 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:15.130867 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 180/365] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:15.132474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe31fe3-689b-45c0-88c1-1726a35ee5a3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:15.166461 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959032a5-4eb1-4607-8640-e5c1f045162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:15.170423 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959032a5-4eb1-4607-8640-e5c1f045162f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:15.171265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959032a5-4eb1-4607-8640-e5c1f045162f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:15.171751 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959032a5-4eb1-4607-8640-e5c1f045162f None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:15.174443 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959032a5-4eb1-4607-8640-e5c1f045162f None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:15.177016 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959032a5-4eb1-4607-8640-e5c1f045162f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:15.181658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 186/366] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:14 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:15.183554 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959032a5-4eb1-4607-8640-e5c1f045162f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:15.290945 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:15.317485 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe31fe3-689b-45c0-88c1-1726a35ee5a3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:15.360833 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959032a5-4eb1-4607-8640-e5c1f045162f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:15.382483 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6e127-7e60-441e-924f-e45874f1741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:15.383366 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6e127-7e60-441e-924f-e45874f1741a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:15.383656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6e127-7e60-441e-924f-e45874f1741a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:15.383939 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6e127-7e60-441e-924f-e45874f1741a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:15.402064 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6e127-7e60-441e-924f-e45874f1741a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:15.420632 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3e21c-dac9-4329-b11f-c7d905066f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:15.421765 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3e21c-dac9-4329-b11f-c7d905066f7d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:15.422196 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3e21c-dac9-4329-b11f-c7d905066f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:15.422659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3e21c-dac9-4329-b11f-c7d905066f7d None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:15.424189 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3e21c-dac9-4329-b11f-c7d905066f7d None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-32e6e127-7e60-441e-924f-e45874f1741a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:15.424436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:15.425320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:15.426113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:15.426113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:15.426113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:15.426113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:15.426113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:15.426113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:15.426113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:15.426113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:15.426113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:15.426113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:15.426113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:31:15.426113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:15.426782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3e21c-dac9-4329-b11f-c7d905066f7d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:15.428244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 187/367] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:15 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:15.429263 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3e21c-dac9-4329-b11f-c7d905066f7d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:15.430861 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 181/368] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:31:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:15.432107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6e127-7e60-441e-924f-e45874f1741a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:15.504977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:15.581399 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6e127-7e60-441e-924f-e45874f1741a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:15.608815 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3e21c-dac9-4329-b11f-c7d905066f7d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:15.626749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993d4ef-08a5-4295-b4aa-717b26829334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:15.627629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993d4ef-08a5-4295-b4aa-717b26829334 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:15.627910 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993d4ef-08a5-4295-b4aa-717b26829334 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:15.628179 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993d4ef-08a5-4295-b4aa-717b26829334 None admin] PATH_INFO: `/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:15.629647 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993d4ef-08a5-4295-b4aa-717b26829334 None admin] RBAC: Authorizing `identity:get_group(group_id=79c67a324e2d42ddaf8761bd1556bdd5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:15.631202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993d4ef-08a5-4295-b4aa-717b26829334 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:15.632941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 182/369] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Jun 15 09:31:15 2022] GET /identity/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:15.633934 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993d4ef-08a5-4295-b4aa-717b26829334 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:15.652746 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:15.670518 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9097cc1-ca64-4b2d-a665-9a03c03852c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:15.671498 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9097cc1-ca64-4b2d-a665-9a03c03852c9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:15.671829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9097cc1-ca64-4b2d-a665-9a03c03852c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:15.672004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9097cc1-ca64-4b2d-a665-9a03c03852c9 None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:15.673362 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9097cc1-ca64-4b2d-a665-9a03c03852c9 None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:15.674880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9097cc1-ca64-4b2d-a665-9a03c03852c9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:15.681568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 188/370] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:15 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:15.682799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9097cc1-ca64-4b2d-a665-9a03c03852c9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:15.775685 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993d4ef-08a5-4295-b4aa-717b26829334 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:15.816976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4617751-867e-48ff-b3ae-19e88705a980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:15.817676 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4617751-867e-48ff-b3ae-19e88705a980 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:15.817965 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4617751-867e-48ff-b3ae-19e88705a980 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:15.818250 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4617751-867e-48ff-b3ae-19e88705a980 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:15.819061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4617751-867e-48ff-b3ae-19e88705a980 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:15.819376 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4617751-867e-48ff-b3ae-19e88705a980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:15.820771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4617751-867e-48ff-b3ae-19e88705a980 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:15.834918 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 183/371] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:15.834918 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4617751-867e-48ff-b3ae-19e88705a980 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:15.873767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9097cc1-ca64-4b2d-a665-9a03c03852c9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:15.900754 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:15.931041 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:15.944541 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180de2-de8c-4b47-a2bd-6ebb3daa1802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:15.945625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180de2-de8c-4b47-a2bd-6ebb3daa1802 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:15.946059 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180de2-de8c-4b47-a2bd-6ebb3daa1802 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:15.946532 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180de2-de8c-4b47-a2bd-6ebb3daa1802 None admin] PATH_INFO: `/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:15.948573 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180de2-de8c-4b47-a2bd-6ebb3daa1802 None admin] RBAC: Authorizing `identity:get_group(group_id=79c67a324e2d42ddaf8761bd1556bdd5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:15.951638 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180de2-de8c-4b47-a2bd-6ebb3daa1802 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:15.962219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 189/372] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Jun 15 09:31:15 2022] GET /identity/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:15.962219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180de2-de8c-4b47-a2bd-6ebb3daa1802 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:15.988262 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4617751-867e-48ff-b3ae-19e88705a980 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:16.054916 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0894d23-8ad2-4f5b-b4be-5566fd89f0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:16.055965 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0894d23-8ad2-4f5b-b4be-5566fd89f0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:16.056640 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0894d23-8ad2-4f5b-b4be-5566fd89f0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:16.057101 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0894d23-8ad2-4f5b-b4be-5566fd89f0f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:16.060059 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0894d23-8ad2-4f5b-b4be-5566fd89f0f1 None admin] RBAC: Adding query filter params (group.id=79c67a324e2d42ddaf8761bd1556bdd5, role.id=f0b3744c39ca4eb7b78ef642c0175a0a, scope.project.id=50c4a61b8f494e029afaea135bfd4777) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:16.060590 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0894d23-8ad2-4f5b-b4be-5566fd89f0f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:16.065001 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0894d23-8ad2-4f5b-b4be-5566fd89f0f1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:16.082574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 184/373] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Jun 15 09:31:15 2022] GET /identity/v3/role_assignments?group.id=79c67a324e2d42ddaf8761bd1556bdd5&scope.project.id=50c4a61b8f494e029afaea135bfd4777&role.id=f0b3744c39ca4eb7b78ef642c0175a0a => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:16.082574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0894d23-8ad2-4f5b-b4be-5566fd89f0f1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:16.138442 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180de2-de8c-4b47-a2bd-6ebb3daa1802 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:16.203316 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc40902-a58c-4a77-bcbd-93b567c2a20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:16.204097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc40902-a58c-4a77-bcbd-93b567c2a20a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:16.204378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc40902-a58c-4a77-bcbd-93b567c2a20a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:16.204650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc40902-a58c-4a77-bcbd-93b567c2a20a None admin] PATH_INFO: `/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:16.206029 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc40902-a58c-4a77-bcbd-93b567c2a20a None admin] RBAC: Authorizing `identity:get_group(group_id=79c67a324e2d42ddaf8761bd1556bdd5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:16.209191 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc40902-a58c-4a77-bcbd-93b567c2a20a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:16.212137 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 190/374] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Jun 15 09:31:15 2022] GET /identity/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5 => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:16.220256 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc40902-a58c-4a77-bcbd-93b567c2a20a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:16.279741 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0894d23-8ad2-4f5b-b4be-5566fd89f0f1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:16.297469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:16.326894 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71275c4-b160-44d4-9fee-7950a1998b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:16.328131 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71275c4-b160-44d4-9fee-7950a1998b5b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:16.328848 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71275c4-b160-44d4-9fee-7950a1998b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:16.329492 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71275c4-b160-44d4-9fee-7950a1998b5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:16.341402 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:16.385100 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc40902-a58c-4a77-bcbd-93b567c2a20a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:16.430692 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72b840-60ec-4d3c-8c8f-8e2d10b78aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:16.431544 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72b840-60ec-4d3c-8c8f-8e2d10b78aea None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:16.432004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72b840-60ec-4d3c-8c8f-8e2d10b78aea None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:16.432481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72b840-60ec-4d3c-8c8f-8e2d10b78aea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:16.433510 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72b840-60ec-4d3c-8c8f-8e2d10b78aea None admin] RBAC: Adding query filter params (group.id=79c67a324e2d42ddaf8761bd1556bdd5, role.id=f0b3744c39ca4eb7b78ef642c0175a0a, scope.project.id=553fd0a11f484754beb16edeccbddc21) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:16.433961 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72b840-60ec-4d3c-8c8f-8e2d10b78aea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:16.436146 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72b840-60ec-4d3c-8c8f-8e2d10b78aea None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:16.449647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 191/375] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Jun 15 09:31:16 2022] GET /identity/v3/role_assignments?group.id=79c67a324e2d42ddaf8761bd1556bdd5&scope.project.id=553fd0a11f484754beb16edeccbddc21&role.id=f0b3744c39ca4eb7b78ef642c0175a0a => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:16.449977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71275c4-b160-44d4-9fee-7950a1998b5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:16.450115 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcbe65-6fa4-41ab-bf30-4cc2fb2ad38f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:16.450115 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcbe65-6fa4-41ab-bf30-4cc2fb2ad38f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:16.450346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71275c4-b160-44d4-9fee-7950a1998b5b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:16.450469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcbe65-6fa4-41ab-bf30-4cc2fb2ad38f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:16.450469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 192/376] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:16.450750 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcbe65-6fa4-41ab-bf30-4cc2fb2ad38f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:16.662803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 185/377] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:16.665123 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8d9d4-9c4b-48fe-8384-35d9091113c8 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:16.665647 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8d9d4-9c4b-48fe-8384-35d9091113c8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:16.666124 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8d9d4-9c4b-48fe-8384-35d9091113c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:16.688846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcbe65-6fa4-41ab-bf30-4cc2fb2ad38f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:16.705298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-4cc8d9d4-9c4b-48fe-8384-35d9091113c8 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:16.707857 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4cc8d9d4-9c4b-48fe-8384-35d9091113c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:16.719728 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:16.768218 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:16.768506 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f295f-12fd-4688-8eb2-a089efcc3381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:16.769631 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f295f-12fd-4688-8eb2-a089efcc3381 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:16.770906 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f295f-12fd-4688-8eb2-a089efcc3381 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:16.771625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f295f-12fd-4688-8eb2-a089efcc3381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:16.773918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f295f-12fd-4688-8eb2-a089efcc3381 None admin] RBAC: Adding query filter params (group.id=79c67a324e2d42ddaf8761bd1556bdd5, role.id=edcc1e17fab74f2d93941e3c37b66546, scope.project.id=553fd0a11f484754beb16edeccbddc21) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:16.774938 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f295f-12fd-4688-8eb2-a089efcc3381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:16.778466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f295f-12fd-4688-8eb2-a089efcc3381 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:16.795629 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 193/378] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Jun 15 09:31:16 2022] GET /identity/v3/role_assignments?group.id=79c67a324e2d42ddaf8761bd1556bdd5&scope.project.id=553fd0a11f484754beb16edeccbddc21&role.id=edcc1e17fab74f2d93941e3c37b66546 => generated 260 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:16.798209 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f295f-12fd-4688-8eb2-a089efcc3381 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:16.886013 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 186/379] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:16.955510 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8d9d4-9c4b-48fe-8384-35d9091113c8 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:17.047129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f295f-12fd-4688-8eb2-a089efcc3381 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:17.130843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf98c7-3541-4b21-9ff6-8aee9a939840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:17.132541 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf98c7-3541-4b21-9ff6-8aee9a939840 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:17.133199 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf98c7-3541-4b21-9ff6-8aee9a939840 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:17.133888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf98c7-3541-4b21-9ff6-8aee9a939840 None admin] PATH_INFO: `/v3/projects/a50595d3c5444c94b0150144dff96117` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:17.136159 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf98c7-3541-4b21-9ff6-8aee9a939840 None admin] RBAC: Authorizing `identity:get_project(project_id=a50595d3c5444c94b0150144dff96117)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:17.139592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf98c7-3541-4b21-9ff6-8aee9a939840 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:17.150280 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 194/380] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:16 2022] GET /identity/v3/projects/a50595d3c5444c94b0150144dff96117 => generated 344 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:17.152870 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf98c7-3541-4b21-9ff6-8aee9a939840 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:17.257469 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8d9d4-9c4b-48fe-8384-35d9091113c8 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:17.265444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:17.314904 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27c2e1-0cf6-4f91-bd73-d4ccafda2622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:17.316712 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27c2e1-0cf6-4f91-bd73-d4ccafda2622 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:17.317487 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27c2e1-0cf6-4f91-bd73-d4ccafda2622 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:17.318284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27c2e1-0cf6-4f91-bd73-d4ccafda2622 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:17.338377 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27c2e1-0cf6-4f91-bd73-d4ccafda2622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9c27c2e1-0cf6-4f91-bd73-d4ccafda2622 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:17.355332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:17.357128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:17.358729 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:17.358729 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:17.358729 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:17.358729 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:17.358729 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:17.358729 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:17.358729 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:17.358729 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:17.358729 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:17.358729 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:17.358729 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:17.358729 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:17.363067 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 187/381] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:17.396640 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27c2e1-0cf6-4f91-bd73-d4ccafda2622 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:17.401801 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf98c7-3541-4b21-9ff6-8aee9a939840 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:17.468682 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:17.485120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256b1a0-9e71-48e8-9b45-49e96af8d839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:17.486625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b1a0-9e71-48e8-9b45-49e96af8d839 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:17.487106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b1a0-9e71-48e8-9b45-49e96af8d839 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:17.487579 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b1a0-9e71-48e8-9b45-49e96af8d839 None admin] PATH_INFO: `/v3/groups/d76e0084ea2f4649ae238e271d591d24` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:17.511608 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256b1a0-9e71-48e8-9b45-49e96af8d839 None admin] RBAC: Authorizing `identity:get_group(group_id=d76e0084ea2f4649ae238e271d591d24)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:17.514470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256b1a0-9e71-48e8-9b45-49e96af8d839 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:17.518520 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 195/382] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Jun 15 09:31:17 2022] GET /identity/v3/groups/d76e0084ea2f4649ae238e271d591d24 => generated 229 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:17.532260 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256b1a0-9e71-48e8-9b45-49e96af8d839 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:17.539108 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27c2e1-0cf6-4f91-bd73-d4ccafda2622 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:17.641221 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a0778-c90c-44de-8f85-e596c9ff6073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:17.642570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a0778-c90c-44de-8f85-e596c9ff6073 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:17.643182 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a0778-c90c-44de-8f85-e596c9ff6073 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:17.643633 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a0778-c90c-44de-8f85-e596c9ff6073 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:17.645478 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a0778-c90c-44de-8f85-e596c9ff6073 None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:17.646188 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a0778-c90c-44de-8f85-e596c9ff6073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:17.649007 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a0778-c90c-44de-8f85-e596c9ff6073 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:17.678480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 188/383] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:31:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:17.688091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a0778-c90c-44de-8f85-e596c9ff6073 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:17.772133 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256b1a0-9e71-48e8-9b45-49e96af8d839 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:17.792965 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:17.875926 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd2f1e-3f24-4409-9359-afdc71d274ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:17.876781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd2f1e-3f24-4409-9359-afdc71d274ad None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:17.877180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd2f1e-3f24-4409-9359-afdc71d274ad None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:17.877560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd2f1e-3f24-4409-9359-afdc71d274ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:17.878595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd2f1e-3f24-4409-9359-afdc71d274ad None admin] RBAC: Adding query filter params (group.id=d76e0084ea2f4649ae238e271d591d24, role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=a50595d3c5444c94b0150144dff96117) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:17.878967 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd2f1e-3f24-4409-9359-afdc71d274ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:17.880692 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd2f1e-3f24-4409-9359-afdc71d274ad None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:17.894169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 196/384] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Jun 15 09:31:17 2022] GET /identity/v3/role_assignments?group.id=d76e0084ea2f4649ae238e271d591d24&scope.project.id=a50595d3c5444c94b0150144dff96117&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 260 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:17.915022 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:17.923280 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a0778-c90c-44de-8f85-e596c9ff6073 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:17.984632 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef68f4-2be5-4f78-a51c-f5f196e6df79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:17.986470 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef68f4-2be5-4f78-a51c-f5f196e6df79 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:17.987194 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef68f4-2be5-4f78-a51c-f5f196e6df79 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:17.987867 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef68f4-2be5-4f78-a51c-f5f196e6df79 None admin] PATH_INFO: `/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:17.990277 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef68f4-2be5-4f78-a51c-f5f196e6df79 None admin] RBAC: Authorizing `identity:get_group(group_id=79c67a324e2d42ddaf8761bd1556bdd5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:17.993177 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef68f4-2be5-4f78-a51c-f5f196e6df79 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:17.996936 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 189/385] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Jun 15 09:31:17 2022] GET /identity/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5 => generated 226 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:18.006097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd2f1e-3f24-4409-9359-afdc71d274ad None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:18.287304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd2f1e-3f24-4409-9359-afdc71d274ad None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:18.378118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c675893-5767-49b7-8d1e-28b4376160df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:18.379654 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c675893-5767-49b7-8d1e-28b4376160df None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:18.380154 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c675893-5767-49b7-8d1e-28b4376160df None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:18.380647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c675893-5767-49b7-8d1e-28b4376160df None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:18.383840 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c675893-5767-49b7-8d1e-28b4376160df None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:18.386729 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c675893-5767-49b7-8d1e-28b4376160df None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:18.391214 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 197/386] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:18 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:18.400659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef68f4-2be5-4f78-a51c-f5f196e6df79 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:18.627949 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef68f4-2be5-4f78-a51c-f5f196e6df79 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:18.692518 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c69bb-6922-4b1e-951c-9ba5c92fdb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:18.695158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c69bb-6922-4b1e-951c-9ba5c92fdb32 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:18.695869 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c69bb-6922-4b1e-951c-9ba5c92fdb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:18.696583 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c69bb-6922-4b1e-951c-9ba5c92fdb32 None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777/groups/79c67a324e2d42ddaf8761bd1556bdd5/roles/edcc1e17fab74f2d93941e3c37b66546` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:18.700443 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c69bb-6922-4b1e-951c-9ba5c92fdb32 None admin] RBAC: Authorizing `identity:create_grant(project_id=50c4a61b8f494e029afaea135bfd4777, group_id=79c67a324e2d42ddaf8761bd1556bdd5, role_id=edcc1e17fab74f2d93941e3c37b66546)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:18.703390 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c69bb-6922-4b1e-951c-9ba5c92fdb32 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:18.732537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 190/387] 10.222.0.45 () {58 vars in 1442 bytes} [Wed Jun 15 09:31:18 2022] PUT /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777/groups/79c67a324e2d42ddaf8761bd1556bdd5/roles/edcc1e17fab74f2d93941e3c37b66546 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 09:31:19.155648 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5951d0-8a70-4ce7-ba7e-f37bf5c7a79d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:19.156025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5951d0-8a70-4ce7-ba7e-f37bf5c7a79d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:19.156241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5951d0-8a70-4ce7-ba7e-f37bf5c7a79d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:19.157768 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 198/388] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:19.163462 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5344dc2-db85-4f28-b009-5d00dc676e26 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:19.163760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5344dc2-db85-4f28-b009-5d00dc676e26 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:19.164054 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5344dc2-db85-4f28-b009-5d00dc676e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:19.184094 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d5344dc2-db85-4f28-b009-5d00dc676e26 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:19.185649 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d5344dc2-db85-4f28-b009-5d00dc676e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:19.201690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:19.284099 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 191/389] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:19.321971 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5951d0-8a70-4ce7-ba7e-f37bf5c7a79d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:19.423596 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:19.553175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5951d0-8a70-4ce7-ba7e-f37bf5c7a79d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:19.640249 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634385fc-05f2-4855-b8fe-191ee44cb052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:19.641654 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634385fc-05f2-4855-b8fe-191ee44cb052 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:19.642141 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634385fc-05f2-4855-b8fe-191ee44cb052 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:19.642676 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634385fc-05f2-4855-b8fe-191ee44cb052 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:19.672781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634385fc-05f2-4855-b8fe-191ee44cb052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-634385fc-05f2-4855-b8fe-191ee44cb052 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:19.693742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:19.695790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:19.697602 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:19.697602 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:19.697602 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:19.697602 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:19.697602 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:19.697602 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:19.697602 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:19.697602 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:19.697602 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:19.697602 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:19.697602 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:31:19.697602 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:19.706052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 199/390] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:31:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:19.716930 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5344dc2-db85-4f28-b009-5d00dc676e26 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:19.835209 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2491b-c256-4e0d-bf88-f74932f6539c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:19.836005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2491b-c256-4e0d-bf88-f74932f6539c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:19.836693 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2491b-c256-4e0d-bf88-f74932f6539c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:19.840729 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 200/391] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:19.849571 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c003af-649e-46b5-b03e-944316c93abb None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:19.850379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c003af-649e-46b5-b03e-944316c93abb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:19.851117 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c003af-649e-46b5-b03e-944316c93abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:19.903670 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-12c003af-649e-46b5-b03e-944316c93abb None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:19.904987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-12c003af-649e-46b5-b03e-944316c93abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:19.949318 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5344dc2-db85-4f28-b009-5d00dc676e26 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:20.002391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effe541-d01e-45fd-ba6d-564d881be412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:20.004467 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effe541-d01e-45fd-ba6d-564d881be412 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:20.005301 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effe541-d01e-45fd-ba6d-564d881be412 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:20.005823 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effe541-d01e-45fd-ba6d-564d881be412 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:20.007397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effe541-d01e-45fd-ba6d-564d881be412 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:20.007964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effe541-d01e-45fd-ba6d-564d881be412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:20.012417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effe541-d01e-45fd-ba6d-564d881be412 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:20.025028 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 192/392] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:20.031976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effe541-d01e-45fd-ba6d-564d881be412 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:20.066971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:20.129745 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 201/393] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:31:20.181932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effe541-d01e-45fd-ba6d-564d881be412 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:20.196238 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c003af-649e-46b5-b03e-944316c93abb None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:20.221264 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4faad-3138-41cd-a8ff-133ea3636b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:20.222360 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4faad-3138-41cd-a8ff-133ea3636b19 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:20.222817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4faad-3138-41cd-a8ff-133ea3636b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:20.223234 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4faad-3138-41cd-a8ff-133ea3636b19 None admin] PATH_INFO: `/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:20.224653 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4faad-3138-41cd-a8ff-133ea3636b19 None admin] RBAC: Authorizing `identity:get_group(group_id=79c67a324e2d42ddaf8761bd1556bdd5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:20.226283 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4faad-3138-41cd-a8ff-133ea3636b19 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:20.228508 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 193/394] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Jun 15 09:31:20 2022] GET /identity/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:20.234302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4faad-3138-41cd-a8ff-133ea3636b19 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:20.284513 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:20.327187 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:20.352320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4faad-3138-41cd-a8ff-133ea3636b19 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:20.390159 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9a326-1203-4a93-b951-c4c315fa9106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:20.391313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9a326-1203-4a93-b951-c4c315fa9106 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:20.391785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9a326-1203-4a93-b951-c4c315fa9106 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:20.392206 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9a326-1203-4a93-b951-c4c315fa9106 None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:20.393963 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9a326-1203-4a93-b951-c4c315fa9106 None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:20.395425 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c003af-649e-46b5-b03e-944316c93abb None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:20.396234 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9a326-1203-4a93-b951-c4c315fa9106 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:20.402833 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 194/395] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:20 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:20.404570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2532f9-1d13-45c6-b978-c73de0db460e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:20.405003 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2532f9-1d13-45c6-b978-c73de0db460e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:20.405418 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2532f9-1d13-45c6-b978-c73de0db460e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:20.407184 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 195/396] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:20.413507 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2532f9-1d13-45c6-b978-c73de0db460e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:20.445255 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61cfe4-5115-42b8-9336-94f6ce511a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:20.447095 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61cfe4-5115-42b8-9336-94f6ce511a36 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:20.447877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61cfe4-5115-42b8-9336-94f6ce511a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:20.448305 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61cfe4-5115-42b8-9336-94f6ce511a36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:20.466255 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61cfe4-5115-42b8-9336-94f6ce511a36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8e61cfe4-5115-42b8-9336-94f6ce511a36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:20.476977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:20.477990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:20.478893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:20.478893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:20.478893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:20.478893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:20.478893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:20.478893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:20.478893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:20.478893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:20.478893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:20.478893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:20.478893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:31:20.478893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:20.485402 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 202/397] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:31:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:20.485402 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00392e-7377-4ddc-a215-1058e6f1887a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:20.485402 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00392e-7377-4ddc-a215-1058e6f1887a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:20.485402 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00392e-7377-4ddc-a215-1058e6f1887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:20.508692 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6b00392e-7377-4ddc-a215-1058e6f1887a None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:20.511108 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6b00392e-7377-4ddc-a215-1058e6f1887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:20.577592 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2532f9-1d13-45c6-b978-c73de0db460e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:20.628313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674834b2-8b05-41d3-9f73-b750ddef0267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:20.629758 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674834b2-8b05-41d3-9f73-b750ddef0267 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:20.630207 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674834b2-8b05-41d3-9f73-b750ddef0267 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:20.630706 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674834b2-8b05-41d3-9f73-b750ddef0267 None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777/groups/79c67a324e2d42ddaf8761bd1556bdd5/roles/f0b3744c39ca4eb7b78ef642c0175a0a` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:20.634285 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674834b2-8b05-41d3-9f73-b750ddef0267 None admin] RBAC: Authorizing `identity:create_grant(project_id=50c4a61b8f494e029afaea135bfd4777, group_id=79c67a324e2d42ddaf8761bd1556bdd5, role_id=f0b3744c39ca4eb7b78ef642c0175a0a)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:20.636319 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674834b2-8b05-41d3-9f73-b750ddef0267 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:20.647339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 203/398] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:20.649324 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00392e-7377-4ddc-a215-1058e6f1887a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:20.666324 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 196/399] 10.222.0.45 () {58 vars in 1442 bytes} [Wed Jun 15 09:31:20 2022] PUT /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777/groups/79c67a324e2d42ddaf8761bd1556bdd5/roles/f0b3744c39ca4eb7b78ef642c0175a0a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:31:20.683286 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674834b2-8b05-41d3-9f73-b750ddef0267 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:20.695456 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:20.697250 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:20.919745 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00392e-7377-4ddc-a215-1058e6f1887a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:20.974183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9009812-6d85-46de-a741-8e2b58389b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:20.974955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9009812-6d85-46de-a741-8e2b58389b25 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:20.975243 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9009812-6d85-46de-a741-8e2b58389b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:20.975525 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9009812-6d85-46de-a741-8e2b58389b25 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:20.976332 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9009812-6d85-46de-a741-8e2b58389b25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:20.976645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9009812-6d85-46de-a741-8e2b58389b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:20.978072 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9009812-6d85-46de-a741-8e2b58389b25 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:20.989544 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 204/400] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:20.995014 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674834b2-8b05-41d3-9f73-b750ddef0267 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:20.995740 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9009812-6d85-46de-a741-8e2b58389b25 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:21.092906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3152be-969e-4647-9e6e-d54a9d1e9acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:21.094779 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3152be-969e-4647-9e6e-d54a9d1e9acc None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:21.095461 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3152be-969e-4647-9e6e-d54a9d1e9acc None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:21.096098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3152be-969e-4647-9e6e-d54a9d1e9acc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:21.141351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3152be-969e-4647-9e6e-d54a9d1e9acc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-db3152be-969e-4647-9e6e-d54a9d1e9acc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:21.159323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:21.161091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:21.162666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:21.162666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:21.162666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:21.162666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:21.162666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:21.162666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:21.162666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:21.162666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:21.162666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:21.162666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:21.162666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:21.162666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:21.168235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 197/401] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 485 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:21.175199 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3152be-969e-4647-9e6e-d54a9d1e9acc None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:21.276668 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:21.338992 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9009812-6d85-46de-a741-8e2b58389b25 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:21.397260 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:21.431296 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34e77e-0376-41ce-b106-c53c7ac4dd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:21.432073 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34e77e-0376-41ce-b106-c53c7ac4dd3f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:21.432350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34e77e-0376-41ce-b106-c53c7ac4dd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:21.432560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34e77e-0376-41ce-b106-c53c7ac4dd3f None admin] PATH_INFO: `/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:21.434283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34e77e-0376-41ce-b106-c53c7ac4dd3f None admin] RBAC: Authorizing `identity:get_group(group_id=79c67a324e2d42ddaf8761bd1556bdd5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:21.435762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34e77e-0376-41ce-b106-c53c7ac4dd3f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:21.437910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 205/402] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Jun 15 09:31:20 2022] GET /identity/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5 => generated 226 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:21.439372 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba5a39-8103-48bd-aa76-ba2e66b55f30 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:21.439659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba5a39-8103-48bd-aa76-ba2e66b55f30 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:21.439934 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba5a39-8103-48bd-aa76-ba2e66b55f30 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:21.441484 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 206/403] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:21.447020 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba5a39-8103-48bd-aa76-ba2e66b55f30 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:21.468424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3152be-969e-4647-9e6e-d54a9d1e9acc None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:21.538024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e1eb7-2336-4027-8be7-2632730d00ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:21.539694 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e1eb7-2336-4027-8be7-2632730d00ea None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:21.540367 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e1eb7-2336-4027-8be7-2632730d00ea None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:21.541034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e1eb7-2336-4027-8be7-2632730d00ea None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:21.542728 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e1eb7-2336-4027-8be7-2632730d00ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:21.544035 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e1eb7-2336-4027-8be7-2632730d00ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:21.548024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e1eb7-2336-4027-8be7-2632730d00ea None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:21.566075 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 198/404] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:31:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:21.568708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa9eca-5532-4f49-a87e-813c3333c43d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:21.569415 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa9eca-5532-4f49-a87e-813c3333c43d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:21.570101 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa9eca-5532-4f49-a87e-813c3333c43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:21.582229 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba5a39-8103-48bd-aa76-ba2e66b55f30 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:21.599448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-4faa9eca-5532-4f49-a87e-813c3333c43d None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:21.601795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4faa9eca-5532-4f49-a87e-813c3333c43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:21.620912 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6866e-4cb6-42bc-ab87-09c6185ae56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:21.623082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6866e-4cb6-42bc-ab87-09c6185ae56a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:21.623082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6866e-4cb6-42bc-ab87-09c6185ae56a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:21.623389 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6866e-4cb6-42bc-ab87-09c6185ae56a None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:21.624528 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6866e-4cb6-42bc-ab87-09c6185ae56a None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:21.625974 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6866e-4cb6-42bc-ab87-09c6185ae56a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:21.628433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 207/405] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:21 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:21.629336 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6866e-4cb6-42bc-ab87-09c6185ae56a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:21.650805 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:21.736430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 199/406] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:21.738237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa9eca-5532-4f49-a87e-813c3333c43d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:21.759788 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6866e-4cb6-42bc-ab87-09c6185ae56a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:21.814039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf300b3-ceed-4459-88c6-b08b9fc8dd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:21.814991 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf300b3-ceed-4459-88c6-b08b9fc8dd9d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:21.815276 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf300b3-ceed-4459-88c6-b08b9fc8dd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:21.815557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf300b3-ceed-4459-88c6-b08b9fc8dd9d None admin] PATH_INFO: `/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:21.816975 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf300b3-ceed-4459-88c6-b08b9fc8dd9d None admin] RBAC: Authorizing `identity:get_group(group_id=79c67a324e2d42ddaf8761bd1556bdd5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:21.818468 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf300b3-ceed-4459-88c6-b08b9fc8dd9d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:21.824986 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 208/407] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Jun 15 09:31:21 2022] GET /identity/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:21.826460 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf300b3-ceed-4459-88c6-b08b9fc8dd9d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:21.861317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:21.921736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa9eca-5532-4f49-a87e-813c3333c43d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:21.937404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:21.963877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf300b3-ceed-4459-88c6-b08b9fc8dd9d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:21.967665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a03cc-ee22-4fcf-af9c-c3a2292672a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:21.968566 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a03cc-ee22-4fcf-af9c-c3a2292672a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:21.970014 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a03cc-ee22-4fcf-af9c-c3a2292672a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:21.970014 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a03cc-ee22-4fcf-af9c-c3a2292672a8 None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21/groups/79c67a324e2d42ddaf8761bd1556bdd5/roles/f0b3744c39ca4eb7b78ef642c0175a0a` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:21.971574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a03cc-ee22-4fcf-af9c-c3a2292672a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=553fd0a11f484754beb16edeccbddc21, group_id=79c67a324e2d42ddaf8761bd1556bdd5, role_id=f0b3744c39ca4eb7b78ef642c0175a0a)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:21.973073 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a03cc-ee22-4fcf-af9c-c3a2292672a8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:22.002644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 200/408] 10.222.0.45 () {58 vars in 1442 bytes} [Wed Jun 15 09:31:21 2022] PUT /identity/v3/projects/553fd0a11f484754beb16edeccbddc21/groups/79c67a324e2d42ddaf8761bd1556bdd5/roles/f0b3744c39ca4eb7b78ef642c0175a0a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:31:22.003812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a03cc-ee22-4fcf-af9c-c3a2292672a8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:22.040982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a7e87-d5fd-40db-a67b-11abdd71d047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:22.041830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a7e87-d5fd-40db-a67b-11abdd71d047 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:22.042151 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a7e87-d5fd-40db-a67b-11abdd71d047 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:22.042373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a7e87-d5fd-40db-a67b-11abdd71d047 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:22.058029 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a7e87-d5fd-40db-a67b-11abdd71d047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-510a7e87-d5fd-40db-a67b-11abdd71d047 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:22.066595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:22.068376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:22.069918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:22.069918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:22.069918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:22.069918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:22.069918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:22.069918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:22.069918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:22.069918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:22.069918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:22.069918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:22.069918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:31:22.069918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:22.073280 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 209/409] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:31:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:22.075293 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f7491-df52-4bf3-9d21-2fc077aa7d05 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:22.075711 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f7491-df52-4bf3-9d21-2fc077aa7d05 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:22.075862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f7491-df52-4bf3-9d21-2fc077aa7d05 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:22.077665 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 210/410] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:22.078589 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f7491-df52-4bf3-9d21-2fc077aa7d05 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:22.202732 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a03cc-ee22-4fcf-af9c-c3a2292672a8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:22.225525 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:22.247268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a942f73-9e1d-4da6-a763-f19d707025ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:22.248003 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a942f73-9e1d-4da6-a763-f19d707025ae None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:22.248275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a942f73-9e1d-4da6-a763-f19d707025ae None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:22.248568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a942f73-9e1d-4da6-a763-f19d707025ae None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:22.249857 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a942f73-9e1d-4da6-a763-f19d707025ae None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:22.251384 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a942f73-9e1d-4da6-a763-f19d707025ae None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:22.253469 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 201/411] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:22 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:22.254362 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d5ebb-c056-4a68-86fa-e800c0be3b2c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:22.254685 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d5ebb-c056-4a68-86fa-e800c0be3b2c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:22.254963 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d5ebb-c056-4a68-86fa-e800c0be3b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:22.258060 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f7491-df52-4bf3-9d21-2fc077aa7d05 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:22.274067 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-cb3d5ebb-c056-4a68-86fa-e800c0be3b2c None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:22.275429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-cb3d5ebb-c056-4a68-86fa-e800c0be3b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:22.341414 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5088bfa-e4b8-469a-adcd-035ef9990df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:22.342238 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5088bfa-e4b8-469a-adcd-035ef9990df3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:22.342626 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5088bfa-e4b8-469a-adcd-035ef9990df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:22.342974 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5088bfa-e4b8-469a-adcd-035ef9990df3 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:22.343873 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5088bfa-e4b8-469a-adcd-035ef9990df3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:22.344255 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5088bfa-e4b8-469a-adcd-035ef9990df3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:22.345757 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5088bfa-e4b8-469a-adcd-035ef9990df3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:22.357496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 211/412] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:22.358186 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5088bfa-e4b8-469a-adcd-035ef9990df3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:22.373806 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:22.390590 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 202/413] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:22.391347 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d5ebb-c056-4a68-86fa-e800c0be3b2c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:22.506228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d5ebb-c056-4a68-86fa-e800c0be3b2c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:22.528701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:22.549572 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4383d4-78d2-4400-91c5-dcee38d4b7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:22.550467 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4383d4-78d2-4400-91c5-dcee38d4b7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:22.551462 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4383d4-78d2-4400-91c5-dcee38d4b7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:22.551649 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4383d4-78d2-4400-91c5-dcee38d4b7e7 None admin] PATH_INFO: `/v3/groups/d76e0084ea2f4649ae238e271d591d24` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:22.552993 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4383d4-78d2-4400-91c5-dcee38d4b7e7 None admin] RBAC: Authorizing `identity:get_group(group_id=d76e0084ea2f4649ae238e271d591d24)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:22.555162 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4383d4-78d2-4400-91c5-dcee38d4b7e7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:22.557691 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 203/414] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Jun 15 09:31:22 2022] GET /identity/v3/groups/d76e0084ea2f4649ae238e271d591d24 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:22.558741 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4383d4-78d2-4400-91c5-dcee38d4b7e7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:22.569341 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5088bfa-e4b8-469a-adcd-035ef9990df3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:22.641426 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5c709-8899-4013-92c2-c08c04158558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:22.643019 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5c709-8899-4013-92c2-c08c04158558 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:22.643788 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5c709-8899-4013-92c2-c08c04158558 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:22.644300 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5c709-8899-4013-92c2-c08c04158558 None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21/groups/79c67a324e2d42ddaf8761bd1556bdd5/roles/edcc1e17fab74f2d93941e3c37b66546` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:22.648040 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5c709-8899-4013-92c2-c08c04158558 None admin] RBAC: Authorizing `identity:create_grant(project_id=553fd0a11f484754beb16edeccbddc21, group_id=79c67a324e2d42ddaf8761bd1556bdd5, role_id=edcc1e17fab74f2d93941e3c37b66546)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:22.650831 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5c709-8899-4013-92c2-c08c04158558 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:22.676518 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 212/415] 10.222.0.45 () {58 vars in 1442 bytes} [Wed Jun 15 09:31:22 2022] PUT /identity/v3/projects/553fd0a11f484754beb16edeccbddc21/groups/79c67a324e2d42ddaf8761bd1556bdd5/roles/edcc1e17fab74f2d93941e3c37b66546 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:31:22.676818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4383d4-78d2-4400-91c5-dcee38d4b7e7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:22.678164 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5c709-8899-4013-92c2-c08c04158558 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:22.720638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e17b19-1f47-4636-9f5d-12cfed3649dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:22.721481 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e17b19-1f47-4636-9f5d-12cfed3649dd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:22.721835 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e17b19-1f47-4636-9f5d-12cfed3649dd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:22.722122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e17b19-1f47-4636-9f5d-12cfed3649dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:22.735549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e17b19-1f47-4636-9f5d-12cfed3649dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-87e17b19-1f47-4636-9f5d-12cfed3649dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:22.743806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:22.745742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:22.747531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:22.747531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:22.747531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:22.747531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:22.747531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:22.747531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:22.747531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:22.747531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:22.747531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:22.747531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:22.747531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:22.747531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:22.747531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 204/416] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:22.756395 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e17b19-1f47-4636-9f5d-12cfed3649dd None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:22.883490 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:22.907116 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:22.977069 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e17b19-1f47-4636-9f5d-12cfed3649dd None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:22.979663 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5c709-8899-4013-92c2-c08c04158558 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:23.022450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab94fdc-ca55-46f9-9a01-569b3255c884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:23.023486 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab94fdc-ca55-46f9-9a01-569b3255c884 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:23.023777 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab94fdc-ca55-46f9-9a01-569b3255c884 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:23.024400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab94fdc-ca55-46f9-9a01-569b3255c884 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:23.024835 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab94fdc-ca55-46f9-9a01-569b3255c884 None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:23.030545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab94fdc-ca55-46f9-9a01-569b3255c884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:23.030545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab94fdc-ca55-46f9-9a01-569b3255c884 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:23.038172 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 205/417] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:31:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:23.049301 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab94fdc-ca55-46f9-9a01-569b3255c884 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:23.065222 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a48cae-d449-47ef-bd6a-91f76dd6b6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:23.066701 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a48cae-d449-47ef-bd6a-91f76dd6b6de None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:23.067190 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a48cae-d449-47ef-bd6a-91f76dd6b6de None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:23.067673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a48cae-d449-47ef-bd6a-91f76dd6b6de None admin] PATH_INFO: `/v3/projects/a50595d3c5444c94b0150144dff96117` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:23.070057 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a48cae-d449-47ef-bd6a-91f76dd6b6de None admin] RBAC: Authorizing `identity:get_project(project_id=a50595d3c5444c94b0150144dff96117)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:23.080338 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a48cae-d449-47ef-bd6a-91f76dd6b6de None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:23.084307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 213/418] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:22 2022] GET /identity/v3/projects/a50595d3c5444c94b0150144dff96117 => generated 344 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:23.090677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a48cae-d449-47ef-bd6a-91f76dd6b6de None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:23.174259 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab94fdc-ca55-46f9-9a01-569b3255c884 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:23.182858 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:23.221992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158c827-f599-445e-a304-7f71dc996928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:23.222737 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158c827-f599-445e-a304-7f71dc996928 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:23.223033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158c827-f599-445e-a304-7f71dc996928 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:23.223319 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158c827-f599-445e-a304-7f71dc996928 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:23.327404 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158c827-f599-445e-a304-7f71dc996928 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:23.327745 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a48cae-d449-47ef-bd6a-91f76dd6b6de None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:23.328876 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158c827-f599-445e-a304-7f71dc996928 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:23.390818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20562b25-7367-4941-9ca1-a3c6c30d3d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:23.392427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20562b25-7367-4941-9ca1-a3c6c30d3d1d None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:23.392916 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20562b25-7367-4941-9ca1-a3c6c30d3d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:23.393647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20562b25-7367-4941-9ca1-a3c6c30d3d1d None admin] PATH_INFO: `/v3/projects/a50595d3c5444c94b0150144dff96117/groups/d76e0084ea2f4649ae238e271d591d24/roles/efaf387c51e14931820f2a9b33ac5175` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:23.397646 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20562b25-7367-4941-9ca1-a3c6c30d3d1d None admin] RBAC: Authorizing `identity:create_grant(project_id=a50595d3c5444c94b0150144dff96117, group_id=d76e0084ea2f4649ae238e271d591d24, role_id=efaf387c51e14931820f2a9b33ac5175)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:23.400625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20562b25-7367-4941-9ca1-a3c6c30d3d1d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:23.407832 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:23.430588 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 214/419] 10.222.0.45 () {58 vars in 1442 bytes} [Wed Jun 15 09:31:23 2022] PUT /identity/v3/projects/a50595d3c5444c94b0150144dff96117/groups/d76e0084ea2f4649ae238e271d591d24/roles/efaf387c51e14931820f2a9b33ac5175 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 09:31:23.433030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170f0fd-d28a-4c65-9f5b-9b82c0feaabe None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:23.433791 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170f0fd-d28a-4c65-9f5b-9b82c0feaabe None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:23.434520 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170f0fd-d28a-4c65-9f5b-9b82c0feaabe None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:23.437757 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 215/420] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:23.451260 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31445b-4804-4622-bcf6-511f83e77b01 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:23.452308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31445b-4804-4622-bcf6-511f83e77b01 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:23.458947 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31445b-4804-4622-bcf6-511f83e77b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:23.472169 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 206/421] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:23.480061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158c827-f599-445e-a304-7f71dc996928 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:23.490538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:23.510087 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-aa31445b-4804-4622-bcf6-511f83e77b01 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:23.512577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-aa31445b-4804-4622-bcf6-511f83e77b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:23.675880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158c827-f599-445e-a304-7f71dc996928 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:23.695590 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 216/422] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:23.721650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31445b-4804-4622-bcf6-511f83e77b01 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:23.744373 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046c5a6-c625-4f4c-a947-d637c9de8f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:23.747363 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046c5a6-c625-4f4c-a947-d637c9de8f56 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:23.748098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046c5a6-c625-4f4c-a947-d637c9de8f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:23.748800 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046c5a6-c625-4f4c-a947-d637c9de8f56 None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:23.752443 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046c5a6-c625-4f4c-a947-d637c9de8f56 None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:23.756082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046c5a6-c625-4f4c-a947-d637c9de8f56 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:23.757118 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 207/423] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:23 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:23.761900 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046c5a6-c625-4f4c-a947-d637c9de8f56 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:23.876559 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31445b-4804-4622-bcf6-511f83e77b01 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:23.942424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:23.954541 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:23.978243 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b8d7e-fcc8-4e2d-9ea6-dd2d75969722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:23.979130 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b8d7e-fcc8-4e2d-9ea6-dd2d75969722 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:23.979417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b8d7e-fcc8-4e2d-9ea6-dd2d75969722 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:23.979701 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b8d7e-fcc8-4e2d-9ea6-dd2d75969722 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:23.993964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046c5a6-c625-4f4c-a947-d637c9de8f56 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:24.012469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b8d7e-fcc8-4e2d-9ea6-dd2d75969722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-145b8d7e-fcc8-4e2d-9ea6-dd2d75969722 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:24.021323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:24.023118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:24.024585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:24.024585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:24.024585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:24.024585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:24.024585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:24.024585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:24.024585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:24.024585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:24.024585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:24.024585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:24.024585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:31:24.024585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:24.034750 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 217/424] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:31:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:24.034750 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b8d7e-fcc8-4e2d-9ea6-dd2d75969722 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:24.084235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7717c-f3ed-4091-850d-d30ffe5e4137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:24.085115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7717c-f3ed-4091-850d-d30ffe5e4137 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:24.085404 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7717c-f3ed-4091-850d-d30ffe5e4137 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:24.085687 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7717c-f3ed-4091-850d-d30ffe5e4137 None admin] PATH_INFO: `/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:24.087809 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7717c-f3ed-4091-850d-d30ffe5e4137 None admin] RBAC: Authorizing `identity:get_group(group_id=79c67a324e2d42ddaf8761bd1556bdd5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:24.089286 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7717c-f3ed-4091-850d-d30ffe5e4137 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:24.094463 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 208/425] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Jun 15 09:31:23 2022] GET /identity/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5 => generated 226 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:24.097805 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7717c-f3ed-4091-850d-d30ffe5e4137 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:24.242238 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7717c-f3ed-4091-850d-d30ffe5e4137 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:24.248577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b8d7e-fcc8-4e2d-9ea6-dd2d75969722 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:24.287226 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caf225-9fec-425c-9236-f900bea95d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:24.290472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caf225-9fec-425c-9236-f900bea95d90 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:24.290789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caf225-9fec-425c-9236-f900bea95d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:24.291076 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caf225-9fec-425c-9236-f900bea95d90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:24.291953 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58caf225-9fec-425c-9236-f900bea95d90 None admin] RBAC: Adding query filter params (group.id=79c67a324e2d42ddaf8761bd1556bdd5, role.id=edcc1e17fab74f2d93941e3c37b66546, scope.project.id=50c4a61b8f494e029afaea135bfd4777) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:24.292275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58caf225-9fec-425c-9236-f900bea95d90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:24.293831 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58caf225-9fec-425c-9236-f900bea95d90 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:24.311209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 209/426] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Jun 15 09:31:24 2022] GET /identity/v3/role_assignments?group.id=79c67a324e2d42ddaf8761bd1556bdd5&scope.project.id=50c4a61b8f494e029afaea135bfd4777&role.id=edcc1e17fab74f2d93941e3c37b66546 => generated 611 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:24.326485 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1652c-a53b-499e-9a0f-d5f546e24b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:24.327222 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1652c-a53b-499e-9a0f-d5f546e24b78 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:24.327563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1652c-a53b-499e-9a0f-d5f546e24b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:24.327896 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1652c-a53b-499e-9a0f-d5f546e24b78 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:24.328689 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1652c-a53b-499e-9a0f-d5f546e24b78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:24.329002 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1652c-a53b-499e-9a0f-d5f546e24b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:24.330511 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1652c-a53b-499e-9a0f-d5f546e24b78 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:24.345080 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 218/427] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:24.346577 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caf225-9fec-425c-9236-f900bea95d90 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:24.374139 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:24.468576 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caf225-9fec-425c-9236-f900bea95d90 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:24.511544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3bdd8-f3c7-432d-87fe-2e6157240d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:24.512235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3bdd8-f3c7-432d-87fe-2e6157240d99 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:24.512526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3bdd8-f3c7-432d-87fe-2e6157240d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:24.512808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3bdd8-f3c7-432d-87fe-2e6157240d99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:24.595280 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3bdd8-f3c7-432d-87fe-2e6157240d99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:24.596897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3bdd8-f3c7-432d-87fe-2e6157240d99 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:24.607790 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:24.678244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a6c15-59df-4413-8c55-415160594c62 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:24.678557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a6c15-59df-4413-8c55-415160594c62 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:24.679089 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a6c15-59df-4413-8c55-415160594c62 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:24.682137 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 219/428] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:31:24.689945 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4814a31-6b38-4fbc-a391-2d4397f5930a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:24.690823 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4814a31-6b38-4fbc-a391-2d4397f5930a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:24.691338 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4814a31-6b38-4fbc-a391-2d4397f5930a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:24.714039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a4814a31-6b38-4fbc-a391-2d4397f5930a None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:24.717334 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a4814a31-6b38-4fbc-a391-2d4397f5930a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:24.770628 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 210/429] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:24.776069 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3bdd8-f3c7-432d-87fe-2e6157240d99 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:24.783315 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:24.826637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 220/430] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:31:24.852174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4814a31-6b38-4fbc-a391-2d4397f5930a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:24.908594 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3bdd8-f3c7-432d-87fe-2e6157240d99 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:24.927876 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:24.970547 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5dd0b-b3b3-4258-8e55-f86ced76c1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:24.971986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5dd0b-b3b3-4258-8e55-f86ced76c1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:24.972427 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5dd0b-b3b3-4258-8e55-f86ced76c1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:24.972852 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5dd0b-b3b3-4258-8e55-f86ced76c1e7 None admin] PATH_INFO: `/v3/projects/50c4a61b8f494e029afaea135bfd4777` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:24.974833 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5dd0b-b3b3-4258-8e55-f86ced76c1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=50c4a61b8f494e029afaea135bfd4777)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:24.977115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5dd0b-b3b3-4258-8e55-f86ced76c1e7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:24.981597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 211/431] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:24 2022] GET /identity/v3/projects/50c4a61b8f494e029afaea135bfd4777 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:24.990178 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5dd0b-b3b3-4258-8e55-f86ced76c1e7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:25.017576 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4814a31-6b38-4fbc-a391-2d4397f5930a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:25.062630 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff9162-3f2f-43cb-a6fc-44376cbc24d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:25.063402 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff9162-3f2f-43cb-a6fc-44376cbc24d4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:25.063690 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff9162-3f2f-43cb-a6fc-44376cbc24d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:25.063968 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff9162-3f2f-43cb-a6fc-44376cbc24d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:25.080379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff9162-3f2f-43cb-a6fc-44376cbc24d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-80ff9162-3f2f-43cb-a6fc-44376cbc24d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:25.089953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:25.090976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:25.091793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:25.091793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:25.091793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:25.091793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:25.091793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:25.091793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:25.091793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:25.091793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:25.091793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:25.091793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:25.091793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:31:25.091793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:25.096482 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 221/432] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:31:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:25.099318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff9162-3f2f-43cb-a6fc-44376cbc24d4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:25.151409 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:25.187001 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5dd0b-b3b3-4258-8e55-f86ced76c1e7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:25.236512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c6a70-36f1-4d21-a2c5-1f5fd952a04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:25.237405 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c6a70-36f1-4d21-a2c5-1f5fd952a04b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:25.237697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c6a70-36f1-4d21-a2c5-1f5fd952a04b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:25.237970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c6a70-36f1-4d21-a2c5-1f5fd952a04b None admin] PATH_INFO: `/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:25.239280 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c6a70-36f1-4d21-a2c5-1f5fd952a04b None admin] RBAC: Authorizing `identity:get_group(group_id=79c67a324e2d42ddaf8761bd1556bdd5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:25.240753 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c6a70-36f1-4d21-a2c5-1f5fd952a04b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:25.242982 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 212/433] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Jun 15 09:31:24 2022] GET /identity/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:25.243164 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff9162-3f2f-43cb-a6fc-44376cbc24d4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:25.252646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c6a70-36f1-4d21-a2c5-1f5fd952a04b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:25.312241 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:25.316734 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3e74e-1fdf-48b0-b14e-cfa96ca7e617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:25.318630 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3e74e-1fdf-48b0-b14e-cfa96ca7e617 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:25.318922 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3e74e-1fdf-48b0-b14e-cfa96ca7e617 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:25.319200 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3e74e-1fdf-48b0-b14e-cfa96ca7e617 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:25.320053 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3e74e-1fdf-48b0-b14e-cfa96ca7e617 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:25.320438 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3e74e-1fdf-48b0-b14e-cfa96ca7e617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:25.322113 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3e74e-1fdf-48b0-b14e-cfa96ca7e617 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:25.337969 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 222/434] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:25.344696 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3e74e-1fdf-48b0-b14e-cfa96ca7e617 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:25.408386 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c6a70-36f1-4d21-a2c5-1f5fd952a04b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:25.460474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476a1ea-944a-42dd-98cf-c8f3389cc4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:25.461959 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476a1ea-944a-42dd-98cf-c8f3389cc4db None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:25.462840 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476a1ea-944a-42dd-98cf-c8f3389cc4db None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:25.463015 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476a1ea-944a-42dd-98cf-c8f3389cc4db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:25.463840 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476a1ea-944a-42dd-98cf-c8f3389cc4db None admin] RBAC: Adding query filter params (group.id=79c67a324e2d42ddaf8761bd1556bdd5, role.id=f0b3744c39ca4eb7b78ef642c0175a0a, scope.project.id=50c4a61b8f494e029afaea135bfd4777) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:25.464159 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476a1ea-944a-42dd-98cf-c8f3389cc4db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:25.466361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476a1ea-944a-42dd-98cf-c8f3389cc4db None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:25.473360 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 213/435] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Jun 15 09:31:25 2022] GET /identity/v3/role_assignments?group.id=79c67a324e2d42ddaf8761bd1556bdd5&scope.project.id=50c4a61b8f494e029afaea135bfd4777&role.id=f0b3744c39ca4eb7b78ef642c0175a0a => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:25.494599 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3e74e-1fdf-48b0-b14e-cfa96ca7e617 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:25.522961 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:25.571150 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8d870-7dc9-4da5-a4bb-468a4a0a4b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:25.572214 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8d870-7dc9-4da5-a4bb-468a4a0a4b6f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:25.572727 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8d870-7dc9-4da5-a4bb-468a4a0a4b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:25.573235 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8d870-7dc9-4da5-a4bb-468a4a0a4b6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:25.724105 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8d870-7dc9-4da5-a4bb-468a4a0a4b6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:25.725612 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8d870-7dc9-4da5-a4bb-468a4a0a4b6f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:25.913431 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:25.920279 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 223/436] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:25.927307 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476a1ea-944a-42dd-98cf-c8f3389cc4db None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:26.138970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476a1ea-944a-42dd-98cf-c8f3389cc4db None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:26.154714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:26.215365 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbb6de-c4de-4985-84b2-1a0a94c0ca4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:26.216848 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbb6de-c4de-4985-84b2-1a0a94c0ca4e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:26.217352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbb6de-c4de-4985-84b2-1a0a94c0ca4e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:26.217926 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbb6de-c4de-4985-84b2-1a0a94c0ca4e None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:26.220364 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbb6de-c4de-4985-84b2-1a0a94c0ca4e None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:26.223181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbb6de-c4de-4985-84b2-1a0a94c0ca4e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:26.226841 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 214/437] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:25 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:26.235855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8d870-7dc9-4da5-a4bb-468a4a0a4b6f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:26.243626 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4e211-4053-43db-9e95-3fa85df8ee80 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:26.244159 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4e211-4053-43db-9e95-3fa85df8ee80 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:26.244673 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4e211-4053-43db-9e95-3fa85df8ee80 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:26.247945 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 215/438] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:26.254871 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50dd43-812f-4315-a74b-1551c0723094 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:26.255380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50dd43-812f-4315-a74b-1551c0723094 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:26.255880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50dd43-812f-4315-a74b-1551c0723094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:26.285333 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-cb50dd43-812f-4315-a74b-1551c0723094 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:26.287512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-cb50dd43-812f-4315-a74b-1551c0723094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:26.419615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8d870-7dc9-4da5-a4bb-468a4a0a4b6f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:26.423956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 216/439] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:31:26.460326 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50dd43-812f-4315-a74b-1551c0723094 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:26.489271 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ee6b0-ac68-4efd-8f51-62605a68b188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:26.490695 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ee6b0-ac68-4efd-8f51-62605a68b188 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:26.491195 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ee6b0-ac68-4efd-8f51-62605a68b188 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:26.491698 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ee6b0-ac68-4efd-8f51-62605a68b188 None admin] PATH_INFO: `/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:26.493871 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ee6b0-ac68-4efd-8f51-62605a68b188 None admin] RBAC: Authorizing `identity:get_group(group_id=79c67a324e2d42ddaf8761bd1556bdd5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:26.496729 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ee6b0-ac68-4efd-8f51-62605a68b188 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:26.507031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 224/440] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Jun 15 09:31:26 2022] GET /identity/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5 => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:26.508996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81002c40-21ac-43b1-b415-918dd7027057 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:26.509556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81002c40-21ac-43b1-b415-918dd7027057 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:26.509871 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81002c40-21ac-43b1-b415-918dd7027057 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:26.511512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 225/441] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:31:26.512765 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81002c40-21ac-43b1-b415-918dd7027057 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:26.607612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50dd43-812f-4315-a74b-1551c0723094 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:26.610695 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:26.614227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:26.652616 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323be672-44ef-45b1-965f-e1ec5cac7c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:26.653880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323be672-44ef-45b1-965f-e1ec5cac7c28 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:26.654336 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323be672-44ef-45b1-965f-e1ec5cac7c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:26.654768 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323be672-44ef-45b1-965f-e1ec5cac7c28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:26.660087 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81002c40-21ac-43b1-b415-918dd7027057 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:26.670172 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323be672-44ef-45b1-965f-e1ec5cac7c28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-323be672-44ef-45b1-965f-e1ec5cac7c28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:26.678620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:26.680400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:26.681989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:26.681989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:26.681989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:26.681989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:26.681989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:26.681989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:26.681989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:26.681989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:26.681989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:26.681989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:26.681989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 09:31:26.681989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:26.681989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 217/442] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:26.683333 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e05e56-55fd-4d52-9902-8d9aac25d155 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:26.683480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e05e56-55fd-4d52-9902-8d9aac25d155 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:26.683923 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e05e56-55fd-4d52-9902-8d9aac25d155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:26.703897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-25e05e56-55fd-4d52-9902-8d9aac25d155 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:26.704347 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a668fa-ea44-46a2-9da9-9f74044d2e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:26.705034 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a668fa-ea44-46a2-9da9-9f74044d2e8e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:26.705318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a668fa-ea44-46a2-9da9-9f74044d2e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:26.705592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a668fa-ea44-46a2-9da9-9f74044d2e8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:26.705746 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-25e05e56-55fd-4d52-9902-8d9aac25d155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:26.706432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a668fa-ea44-46a2-9da9-9f74044d2e8e None admin] RBAC: Adding query filter params (group.id=79c67a324e2d42ddaf8761bd1556bdd5, role.id=f0b3744c39ca4eb7b78ef642c0175a0a, scope.project.id=553fd0a11f484754beb16edeccbddc21) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:26.706783 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a668fa-ea44-46a2-9da9-9f74044d2e8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:26.708266 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a668fa-ea44-46a2-9da9-9f74044d2e8e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:26.715634 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 226/443] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Jun 15 09:31:26 2022] GET /identity/v3/role_assignments?group.id=79c67a324e2d42ddaf8761bd1556bdd5&scope.project.id=553fd0a11f484754beb16edeccbddc21&role.id=f0b3744c39ca4eb7b78ef642c0175a0a => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:26.716304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a668fa-ea44-46a2-9da9-9f74044d2e8e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:26.839208 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 218/444] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:26.878439 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e05e56-55fd-4d52-9902-8d9aac25d155 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:26.878978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a668fa-ea44-46a2-9da9-9f74044d2e8e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:26.937846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:26.945719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0bd9d-33e8-422c-9a2f-371568c3c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:26.946706 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0bd9d-33e8-422c-9a2f-371568c3c675 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:26.947110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0bd9d-33e8-422c-9a2f-371568c3c675 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:26.947531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0bd9d-33e8-422c-9a2f-371568c3c675 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:26.948929 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0bd9d-33e8-422c-9a2f-371568c3c675 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:26.949362 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0bd9d-33e8-422c-9a2f-371568c3c675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:26.951651 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0bd9d-33e8-422c-9a2f-371568c3c675 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:26.968375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 227/445] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:31:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:26.976127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0bd9d-33e8-422c-9a2f-371568c3c675 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:27.033652 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:27.042901 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e05e56-55fd-4d52-9902-8d9aac25d155 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:27.094002 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35c35f-fd33-4ada-9538-23be13173a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:27.094918 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35c35f-fd33-4ada-9538-23be13173a66 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:27.095320 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35c35f-fd33-4ada-9538-23be13173a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:27.095690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35c35f-fd33-4ada-9538-23be13173a66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:27.113018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35c35f-fd33-4ada-9538-23be13173a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ca35c35f-fd33-4ada-9538-23be13173a66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:27.127380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:27.129010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:27.130808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:27.130808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:27.130808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:27.130808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:27.130808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:27.130808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:27.130808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:27.130808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:27.130808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:27.130808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:27.130808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:31:27.130808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:27.130808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 219/446] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:31:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:27.132230 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0bd9d-33e8-422c-9a2f-371568c3c675 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:27.138425 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35c35f-fd33-4ada-9538-23be13173a66 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:27.175798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d1fd2-187b-4a99-be42-bfd51b87adce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:27.176607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d1fd2-187b-4a99-be42-bfd51b87adce None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:27.176932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d1fd2-187b-4a99-be42-bfd51b87adce None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:27.177250 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d1fd2-187b-4a99-be42-bfd51b87adce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:27.269018 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:27.279480 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d1fd2-187b-4a99-be42-bfd51b87adce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:27.280964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35c35f-fd33-4ada-9538-23be13173a66 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:27.281680 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d1fd2-187b-4a99-be42-bfd51b87adce None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:27.331359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176f068-df0e-4da0-9feb-dcc3bbc7de97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:27.332152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176f068-df0e-4da0-9feb-dcc3bbc7de97 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:27.332526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176f068-df0e-4da0-9feb-dcc3bbc7de97 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:27.332982 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176f068-df0e-4da0-9feb-dcc3bbc7de97 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:27.334315 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176f068-df0e-4da0-9feb-dcc3bbc7de97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:27.334883 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176f068-df0e-4da0-9feb-dcc3bbc7de97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:27.337468 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176f068-df0e-4da0-9feb-dcc3bbc7de97 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:27.351250 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 220/447] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:27.357571 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176f068-df0e-4da0-9feb-dcc3bbc7de97 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:27.382603 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:27.428721 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 228/448] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:27.436338 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d1fd2-187b-4a99-be42-bfd51b87adce None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:27.478228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176f068-df0e-4da0-9feb-dcc3bbc7de97 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:27.527651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483cdea-b6a0-403e-86de-b526ac6ab375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:27.528689 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483cdea-b6a0-403e-86de-b526ac6ab375 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:27.529289 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483cdea-b6a0-403e-86de-b526ac6ab375 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:27.529753 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483cdea-b6a0-403e-86de-b526ac6ab375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:27.569583 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:27.577468 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d1fd2-187b-4a99-be42-bfd51b87adce None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:27.613411 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483cdea-b6a0-403e-86de-b526ac6ab375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:27.615193 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483cdea-b6a0-403e-86de-b526ac6ab375 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:27.623280 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d204305-3c3d-48d3-848d-c64e78da956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:27.624250 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d204305-3c3d-48d3-848d-c64e78da956d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:27.624619 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d204305-3c3d-48d3-848d-c64e78da956d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:27.625019 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d204305-3c3d-48d3-848d-c64e78da956d None admin] PATH_INFO: `/v3/projects/553fd0a11f484754beb16edeccbddc21` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:27.626403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d204305-3c3d-48d3-848d-c64e78da956d None admin] RBAC: Authorizing `identity:get_project(project_id=553fd0a11f484754beb16edeccbddc21)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:27.628080 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d204305-3c3d-48d3-848d-c64e78da956d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:27.630031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 229/449] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:27 2022] GET /identity/v3/projects/553fd0a11f484754beb16edeccbddc21 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:27.635804 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:27.639056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d204305-3c3d-48d3-848d-c64e78da956d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:27.724821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 221/450] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 09:31:27.731076 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483cdea-b6a0-403e-86de-b526ac6ab375 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:27.789358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d204305-3c3d-48d3-848d-c64e78da956d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:27.827936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d9614-fa4d-4006-8689-d8e9f27811c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:27.829035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d9614-fa4d-4006-8689-d8e9f27811c1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:27.829416 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d9614-fa4d-4006-8689-d8e9f27811c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:27.829840 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d9614-fa4d-4006-8689-d8e9f27811c1 None admin] PATH_INFO: `/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:27.831431 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d9614-fa4d-4006-8689-d8e9f27811c1 None admin] RBAC: Authorizing `identity:get_group(group_id=79c67a324e2d42ddaf8761bd1556bdd5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:27.833086 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d9614-fa4d-4006-8689-d8e9f27811c1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:27.835104 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 230/451] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Jun 15 09:31:27 2022] GET /identity/v3/groups/79c67a324e2d42ddaf8761bd1556bdd5 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:27.843889 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d9614-fa4d-4006-8689-d8e9f27811c1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:27.877110 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483cdea-b6a0-403e-86de-b526ac6ab375 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:27.887499 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:27.899240 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:27.923021 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f18eda-cc7c-47d7-b8ac-19b15bc5bad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:27.923939 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f18eda-cc7c-47d7-b8ac-19b15bc5bad3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:27.924225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f18eda-cc7c-47d7-b8ac-19b15bc5bad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:27.924502 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f18eda-cc7c-47d7-b8ac-19b15bc5bad3 None admin] PATH_INFO: `/v3/projects/a50595d3c5444c94b0150144dff96117` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:27.925799 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f18eda-cc7c-47d7-b8ac-19b15bc5bad3 None admin] RBAC: Authorizing `identity:get_project(project_id=a50595d3c5444c94b0150144dff96117)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:27.927359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f18eda-cc7c-47d7-b8ac-19b15bc5bad3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:27.929125 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 222/452] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:31:27 2022] GET /identity/v3/projects/a50595d3c5444c94b0150144dff96117 => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:27.935430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f18eda-cc7c-47d7-b8ac-19b15bc5bad3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:27.975957 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d9614-fa4d-4006-8689-d8e9f27811c1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:28.021969 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada9b52-55ed-42a2-a057-e84ec01b62f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:28.022904 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada9b52-55ed-42a2-a057-e84ec01b62f6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:28.023380 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada9b52-55ed-42a2-a057-e84ec01b62f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:28.023802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada9b52-55ed-42a2-a057-e84ec01b62f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:28.025017 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada9b52-55ed-42a2-a057-e84ec01b62f6 None admin] RBAC: Adding query filter params (group.id=79c67a324e2d42ddaf8761bd1556bdd5, role.id=edcc1e17fab74f2d93941e3c37b66546, scope.project.id=553fd0a11f484754beb16edeccbddc21) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:28.025488 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada9b52-55ed-42a2-a057-e84ec01b62f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:28.027597 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada9b52-55ed-42a2-a057-e84ec01b62f6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:28.034369 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 231/453] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Jun 15 09:31:27 2022] GET /identity/v3/role_assignments?group.id=79c67a324e2d42ddaf8761bd1556bdd5&scope.project.id=553fd0a11f484754beb16edeccbddc21&role.id=edcc1e17fab74f2d93941e3c37b66546 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:28.074057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f18eda-cc7c-47d7-b8ac-19b15bc5bad3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:28.119675 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2c836-f78b-48fd-97e1-e507b328b626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:28.120691 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2c836-f78b-48fd-97e1-e507b328b626 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:28.121019 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2c836-f78b-48fd-97e1-e507b328b626 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:28.121345 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2c836-f78b-48fd-97e1-e507b328b626 None admin] PATH_INFO: `/v3/groups/d76e0084ea2f4649ae238e271d591d24` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:28.122830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2c836-f78b-48fd-97e1-e507b328b626 None admin] RBAC: Authorizing `identity:get_group(group_id=d76e0084ea2f4649ae238e271d591d24)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:28.124387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2c836-f78b-48fd-97e1-e507b328b626 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:28.126354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 223/454] 10.222.0.45 () {56 vars in 1180 bytes} [Wed Jun 15 09:31:27 2022] GET /identity/v3/groups/d76e0084ea2f4649ae238e271d591d24 => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:28.133789 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada9b52-55ed-42a2-a057-e84ec01b62f6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:28.273740 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:28.287760 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada9b52-55ed-42a2-a057-e84ec01b62f6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:28.351089 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059e2b9-c769-480b-9c91-936d593c50df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:28.352130 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059e2b9-c769-480b-9c91-936d593c50df None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:28.352659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059e2b9-c769-480b-9c91-936d593c50df None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:28.353137 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059e2b9-c769-480b-9c91-936d593c50df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:28.354797 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059e2b9-c769-480b-9c91-936d593c50df None admin] RBAC: Adding query filter params (group.id=d76e0084ea2f4649ae238e271d591d24, role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=a50595d3c5444c94b0150144dff96117) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:28.355349 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059e2b9-c769-480b-9c91-936d593c50df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:28.358177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059e2b9-c769-480b-9c91-936d593c50df None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:28.369800 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 232/455] 10.222.0.45 () {56 vars in 1376 bytes} [Wed Jun 15 09:31:28 2022] GET /identity/v3/role_assignments?group.id=d76e0084ea2f4649ae238e271d591d24&scope.project.id=a50595d3c5444c94b0150144dff96117&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 611 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:31.082162 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c88df-bf9e-43f6-8ceb-52a5dc6dea09 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:31.082716 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c88df-bf9e-43f6-8ceb-52a5dc6dea09 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:31.083150 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c88df-bf9e-43f6-8ceb-52a5dc6dea09 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:31.086078 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 224/456] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:31.092838 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97d03e-d721-4781-908b-0633d5ee28c5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:31.093356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97d03e-d721-4781-908b-0633d5ee28c5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:31.093807 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97d03e-d721-4781-908b-0633d5ee28c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:31.128856 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7d97d03e-d721-4781-908b-0633d5ee28c5 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:31.130970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7d97d03e-d721-4781-908b-0633d5ee28c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:31.301530 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 233/457] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:31.346285 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c88df-bf9e-43f6-8ceb-52a5dc6dea09 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:31.480488 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:31.580389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c88df-bf9e-43f6-8ceb-52a5dc6dea09 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:31.634983 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f19868-cd36-4959-bba7-fd98daa21489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:31.636254 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19868-cd36-4959-bba7-fd98daa21489 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:31.636539 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19868-cd36-4959-bba7-fd98daa21489 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:31.636807 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19868-cd36-4959-bba7-fd98daa21489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:31.653656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f19868-cd36-4959-bba7-fd98daa21489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:31.655207 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f19868-cd36-4959-bba7-fd98daa21489 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:31.680181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f8f19868-cd36-4959-bba7-fd98daa21489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:31.680181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:31.680181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:31.680181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:31.680181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:31.680181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:31.680181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:31.680181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:31.680181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:31.680181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:31.680181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:31.680181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:31.680181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:31.680181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:31.680181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:31.681771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:31.685059 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:31.685059 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:31.685059 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:31.685059 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:31.685059 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 225/458] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:31.690973 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97d03e-d721-4781-908b-0633d5ee28c5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:31.784489 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35b342-a469-4954-bc5b-cc0190a54240 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:31.784966 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35b342-a469-4954-bc5b-cc0190a54240 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:31.785453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35b342-a469-4954-bc5b-cc0190a54240 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:31.788411 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 226/459] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:31:31.796781 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397df121-0350-4104-97f5-a636b6b1fdaf None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:31.797250 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397df121-0350-4104-97f5-a636b6b1fdaf None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:31.797737 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397df121-0350-4104-97f5-a636b6b1fdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:31.829945 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:31.836845 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-397df121-0350-4104-97f5-a636b6b1fdaf None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:31.838653 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-397df121-0350-4104-97f5-a636b6b1fdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:31.860460 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97d03e-d721-4781-908b-0633d5ee28c5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:31.935317 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4286-1052-4527-91e3-65c13b005a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:31.935891 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4286-1052-4527-91e3-65c13b005a8b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:31.936177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4286-1052-4527-91e3-65c13b005a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:31.936449 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4286-1052-4527-91e3-65c13b005a8b None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:31.937195 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a4286-1052-4527-91e3-65c13b005a8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:31.937734 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a4286-1052-4527-91e3-65c13b005a8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:31.939153 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a4286-1052-4527-91e3-65c13b005a8b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:31.964234 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 234/460] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:31.975778 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4286-1052-4527-91e3-65c13b005a8b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:31.995440 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 227/461] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:31:32.040696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397df121-0350-4104-97f5-a636b6b1fdaf None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:32.151237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:32.206486 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4286-1052-4527-91e3-65c13b005a8b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:32.273282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ce8ff-da10-4fdf-95b9-b958e73a5cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:32.274455 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ce8ff-da10-4fdf-95b9-b958e73a5cfc None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:32.275006 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ce8ff-da10-4fdf-95b9-b958e73a5cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:32.275505 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ce8ff-da10-4fdf-95b9-b958e73a5cfc None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:32.276924 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ce8ff-da10-4fdf-95b9-b958e73a5cfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:32.279876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ce8ff-da10-4fdf-95b9-b958e73a5cfc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:32.333482 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 235/462] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:31:31 2022] POST /identity/v3/users => generated 246 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 09:31:32.367523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397df121-0350-4104-97f5-a636b6b1fdaf None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:32.392956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e173117-095c-457b-a665-c1ce413dd3b3 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:32.393449 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e173117-095c-457b-a665-c1ce413dd3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:32.393950 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e173117-095c-457b-a665-c1ce413dd3b3 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:32.397136 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 236/463] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:32.403356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d1e78-cbeb-46f4-a9ef-7fb0aebedeed None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:32.403649 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d1e78-cbeb-46f4-a9ef-7fb0aebedeed None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:32.403937 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d1e78-cbeb-46f4-a9ef-7fb0aebedeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:32.419133 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:32.436179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-042d1e78-cbeb-46f4-a9ef-7fb0aebedeed None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:32.437507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-042d1e78-cbeb-46f4-a9ef-7fb0aebedeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:32.446818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd7878-7b0e-4ecf-9b01-765285e00435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:32.447651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7878-7b0e-4ecf-9b01-765285e00435 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:32.447988 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7878-7b0e-4ecf-9b01-765285e00435 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:32.448273 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7878-7b0e-4ecf-9b01-765285e00435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:32.471140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd7878-7b0e-4ecf-9b01-765285e00435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:32.472990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd7878-7b0e-4ecf-9b01-765285e00435 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:32.515472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7ffd7878-7b0e-4ecf-9b01-765285e00435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:32.515472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:32.515472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:32.515472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:32.515472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:32.515472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:32.515472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:32.515472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:32.515472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:32.515472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:32.515472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:32.515472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:32.515472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:32.515472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:32.515472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:32.516421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:32.517290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:32.517290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:32.517290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:32.517290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:32.526786 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 228/464] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 487 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:32.529208 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f2f3f-123c-4d90-992d-1fb4449cfb0a None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:32.529687 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f2f3f-123c-4d90-992d-1fb4449cfb0a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:32.530139 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f2f3f-123c-4d90-992d-1fb4449cfb0a None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:32.531793 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 229/465] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:32.538307 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f2f3f-123c-4d90-992d-1fb4449cfb0a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:32.567691 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 237/466] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:31:32.569966 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c1a01-e0e3-4604-8cba-92bd13a5b2f4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:32.570327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c1a01-e0e3-4604-8cba-92bd13a5b2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:32.570618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c1a01-e0e3-4604-8cba-92bd13a5b2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:32.600311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-961c1a01-e0e3-4604-8cba-92bd13a5b2f4 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:32.602300 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-961c1a01-e0e3-4604-8cba-92bd13a5b2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:32.714215 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:32.725758 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f2f3f-123c-4d90-992d-1fb4449cfb0a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:32.752748 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 238/467] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:32.754896 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c1a01-e0e3-4604-8cba-92bd13a5b2f4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:32.779576 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850e1bf-9410-4a65-9563-b7602a294971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:32.780466 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850e1bf-9410-4a65-9563-b7602a294971 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:32.780761 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850e1bf-9410-4a65-9563-b7602a294971 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:32.781042 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850e1bf-9410-4a65-9563-b7602a294971 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:32.781813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850e1bf-9410-4a65-9563-b7602a294971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:32.782128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850e1bf-9410-4a65-9563-b7602a294971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:32.784261 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850e1bf-9410-4a65-9563-b7602a294971 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:32.800554 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 230/468] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:32.814945 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850e1bf-9410-4a65-9563-b7602a294971 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:32.884564 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:32.951045 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c1a01-e0e3-4604-8cba-92bd13a5b2f4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:32.957872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850e1bf-9410-4a65-9563-b7602a294971 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:33.003072 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b1c8f-ec08-45e8-81d8-78df5ae670dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:33.003924 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b1c8f-ec08-45e8-81d8-78df5ae670dd None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:33.004319 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b1c8f-ec08-45e8-81d8-78df5ae670dd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:33.004729 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b1c8f-ec08-45e8-81d8-78df5ae670dd None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:33.005649 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b1c8f-ec08-45e8-81d8-78df5ae670dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:33.008267 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b1c8f-ec08-45e8-81d8-78df5ae670dd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:33.019138 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9b88b-c35f-4eca-9bf0-57b3edf6e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:33.022125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9b88b-c35f-4eca-9bf0-57b3edf6e4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:33.023044 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9b88b-c35f-4eca-9bf0-57b3edf6e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:33.024295 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9b88b-c35f-4eca-9bf0-57b3edf6e4f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:33.046824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 231/469] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:31:32 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 09:31:33.048433 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b1c8f-ec08-45e8-81d8-78df5ae670dd None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:33.048865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9b88b-c35f-4eca-9bf0-57b3edf6e4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:33.052226 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9b88b-c35f-4eca-9bf0-57b3edf6e4f4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:33.053531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:33.092415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-01b9b88b-c35f-4eca-9bf0-57b3edf6e4f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:33.092415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:33.092415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:33.092415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:33.092415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:33.092415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:33.092415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:33.092415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:33.092415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:33.092415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:33.092415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:33.092415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:33.092415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:33.092415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:33.092415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:33.094022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:33.095695 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:33.095695 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:33.095695 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:33.095695 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:33.106757 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 239/470] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:33.110153 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9b88b-c35f-4eca-9bf0-57b3edf6e4f4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:33.243648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b1c8f-ec08-45e8-81d8-78df5ae670dd None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:33.286170 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c398aff-cdcb-426b-878a-48d64904f75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:33.286966 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c398aff-cdcb-426b-878a-48d64904f75e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:33.287258 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c398aff-cdcb-426b-878a-48d64904f75e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:33.287541 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c398aff-cdcb-426b-878a-48d64904f75e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:33.301368 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c398aff-cdcb-426b-878a-48d64904f75e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:33.302552 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9b88b-c35f-4eca-9bf0-57b3edf6e4f4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:33.303281 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c398aff-cdcb-426b-878a-48d64904f75e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:33.323838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-6c398aff-cdcb-426b-878a-48d64904f75e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:33.323838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:33.323838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:33.323838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:33.323838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:33.323838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:33.323838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:33.323838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:33.323838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:33.323838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:33.323838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:33.323838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:33.323838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:33.323838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:33.323838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:33.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:33.329092 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:33.329092 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:33.329092 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:33.329092 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:33.329853 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:33.330062 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 232/471] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:33.330062 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0f73a-a2e7-4c28-af23-00290bcd8f90 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:33.330062 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0f73a-a2e7-4c28-af23-00290bcd8f90 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:33.330062 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0f73a-a2e7-4c28-af23-00290bcd8f90 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:33.334578 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 233/472] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:33.335460 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0f73a-a2e7-4c28-af23-00290bcd8f90 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:33.346862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84282f3-e520-4908-a4d0-57d433f3b837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:33.347549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84282f3-e520-4908-a4d0-57d433f3b837 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:33.347830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84282f3-e520-4908-a4d0-57d433f3b837 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:33.348108 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84282f3-e520-4908-a4d0-57d433f3b837 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:33.348977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84282f3-e520-4908-a4d0-57d433f3b837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:33.349290 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84282f3-e520-4908-a4d0-57d433f3b837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:33.350886 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84282f3-e520-4908-a4d0-57d433f3b837 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:33.365214 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 240/473] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:33.366781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a7d8-e08f-4771-99cb-dfa8dc77d767 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:33.367073 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a7d8-e08f-4771-99cb-dfa8dc77d767 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:33.367355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a7d8-e08f-4771-99cb-dfa8dc77d767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:33.387340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-85e8a7d8-e08f-4771-99cb-dfa8dc77d767 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:33.388567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-85e8a7d8-e08f-4771-99cb-dfa8dc77d767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:33.409806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:33.476700 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0f73a-a2e7-4c28-af23-00290bcd8f90 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:33.515861 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 241/474] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:33.517479 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8a7d8-e08f-4771-99cb-dfa8dc77d767 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:33.526740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e6c12-deb1-41fd-9c49-16e42991a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:33.527728 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e6c12-deb1-41fd-9c49-16e42991a547 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:33.527728 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e6c12-deb1-41fd-9c49-16e42991a547 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:33.527979 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e6c12-deb1-41fd-9c49-16e42991a547 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:33.528884 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e6c12-deb1-41fd-9c49-16e42991a547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:33.529203 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e6c12-deb1-41fd-9c49-16e42991a547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:33.530947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e6c12-deb1-41fd-9c49-16e42991a547 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:33.549807 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 234/475] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:33.559554 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e6c12-deb1-41fd-9c49-16e42991a547 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:33.658304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8a7d8-e08f-4771-99cb-dfa8dc77d767 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:33.675056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:33.724871 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e6c12-deb1-41fd-9c49-16e42991a547 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:33.731837 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2dffe-9b5d-45fe-854e-f9552882a621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:33.733114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2dffe-9b5d-45fe-854e-f9552882a621 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:33.733651 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2dffe-9b5d-45fe-854e-f9552882a621 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:33.734236 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2dffe-9b5d-45fe-854e-f9552882a621 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:33.735847 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2dffe-9b5d-45fe-854e-f9552882a621 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:33.739062 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2dffe-9b5d-45fe-854e-f9552882a621 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:33.744071 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:33.772258 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4a29d-6b9b-485c-96b1-76a64542855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:33.772961 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4a29d-6b9b-485c-96b1-76a64542855c None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:33.773322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4a29d-6b9b-485c-96b1-76a64542855c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:33.773495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4a29d-6b9b-485c-96b1-76a64542855c None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:33.774245 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4a29d-6b9b-485c-96b1-76a64542855c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:33.775919 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4a29d-6b9b-485c-96b1-76a64542855c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:33.792874 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 242/476] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:31:33 2022] POST /identity/v3/users => generated 249 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:31:33.792874 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2dffe-9b5d-45fe-854e-f9552882a621 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:33.809397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 235/477] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:31:33 2022] POST /identity/v3/users => generated 248 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 09:31:33.973337 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2dffe-9b5d-45fe-854e-f9552882a621 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:34.028297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21350b83-18fc-4b4c-b53b-71438416aae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:34.029014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21350b83-18fc-4b4c-b53b-71438416aae5 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:34.029296 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21350b83-18fc-4b4c-b53b-71438416aae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:34.029571 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21350b83-18fc-4b4c-b53b-71438416aae5 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:34.030351 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21350b83-18fc-4b4c-b53b-71438416aae5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:34.031870 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21350b83-18fc-4b4c-b53b-71438416aae5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:34.042191 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.sql.core [None req-21350b83-18fc-4b4c-b53b-71438416aae5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 09:31:34.042191 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 15 09:31:34.042191 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [parameters: {'id': 'a0dfbec5017b49f4bfcc7d837176f401', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 15 09:31:34.042191 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80319) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 09:31:34.060285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-21350b83-18fc-4b4c-b53b-71438416aae5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 15 09:31:34.060285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:34.060285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 09:31:34.060285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 09:31:34.060285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 09:31:34.060285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 09:31:34.060285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 09:31:34.060285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 09:31:34.060285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 09:31:34.060285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) Jun 15 09:31:34.060285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 09:31:34.060285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 09:31:34.060285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 09:31:34.060285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() Jun 15 09:31:34.060285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return ref.to_dict() Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 09:31:34.062829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application yield resource Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise self.value Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application session.commit() Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 09:31:34.071106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.flush() Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application compat.raise_( Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 09:31:34.075318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 09:31:34.080799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 09:31:34.083993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [parameters: {'id': 'a0dfbec5017b49f4bfcc7d837176f401', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:34.094220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 15 09:31:34.097897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:34.109625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 243/478] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Jun 15 09:31:33 2022] POST /identity/v3/roles => generated 144 bytes in 271 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:34.109859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4a29d-6b9b-485c-96b1-76a64542855c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:34.262321 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4a29d-6b9b-485c-96b1-76a64542855c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:34.305506 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac52f5-964f-4f88-8c9c-49776ec38b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:34.306322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac52f5-964f-4f88-8c9c-49776ec38b66 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:34.306635 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac52f5-964f-4f88-8c9c-49776ec38b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:34.306947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac52f5-964f-4f88-8c9c-49776ec38b66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:34.319281 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac52f5-964f-4f88-8c9c-49776ec38b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-63ac52f5-964f-4f88-8c9c-49776ec38b66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:34.328190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:34.330703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:34.335516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:34.335516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:34.335516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:34.335516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:34.335516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:34.335516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:34.335516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:34.335516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:34.335516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:34.335516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:34.335516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 09:31:34.335516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:34.335516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 236/479] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:31:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:34.339110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21350b83-18fc-4b4c-b53b-71438416aae5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:34.369471 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:34.450047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21350b83-18fc-4b4c-b53b-71438416aae5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:34.489271 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10fcda-f20b-4a40-9e40-62df9c032b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:34.489951 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10fcda-f20b-4a40-9e40-62df9c032b4c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:34.490239 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10fcda-f20b-4a40-9e40-62df9c032b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:34.490535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10fcda-f20b-4a40-9e40-62df9c032b4c None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:34.491344 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10fcda-f20b-4a40-9e40-62df9c032b4c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:34.491691 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10fcda-f20b-4a40-9e40-62df9c032b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:34.493078 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10fcda-f20b-4a40-9e40-62df9c032b4c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:34.502813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 244/480] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:36.170059 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb049c-9a54-4fcb-acca-73eb34774e3d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:36.170958 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb049c-9a54-4fcb-acca-73eb34774e3d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:36.171424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb049c-9a54-4fcb-acca-73eb34774e3d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:36.173551 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 237/481] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:36.174730 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027de507-64bd-4862-8d4f-3e49ab75865d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:36.175153 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027de507-64bd-4862-8d4f-3e49ab75865d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:36.175318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027de507-64bd-4862-8d4f-3e49ab75865d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:36.176700 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 245/482] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:36.179001 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6221bc8-829f-42ae-a492-1ba1b5be990a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:36.179542 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6221bc8-829f-42ae-a492-1ba1b5be990a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:36.180017 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6221bc8-829f-42ae-a492-1ba1b5be990a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:36.184945 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99882717-aa5e-467b-85a5-104874fba2c5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:36.185238 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99882717-aa5e-467b-85a5-104874fba2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:36.185525 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99882717-aa5e-467b-85a5-104874fba2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:36.208940 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d6221bc8-829f-42ae-a492-1ba1b5be990a None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:36.210776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d6221bc8-829f-42ae-a492-1ba1b5be990a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:36.223261 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-99882717-aa5e-467b-85a5-104874fba2c5 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:36.224858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-99882717-aa5e-467b-85a5-104874fba2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:36.284185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:36.308911 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 246/483] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:31:36.355007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99882717-aa5e-467b-85a5-104874fba2c5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:36.376228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:36.401708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 238/484] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:36.472994 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99882717-aa5e-467b-85a5-104874fba2c5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:36.474144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6221bc8-829f-42ae-a492-1ba1b5be990a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:36.513842 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28e518-ac77-4af7-918c-7a5a66ad4e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:36.515072 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28e518-ac77-4af7-918c-7a5a66ad4e14 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:36.515561 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28e518-ac77-4af7-918c-7a5a66ad4e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:36.516055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28e518-ac77-4af7-918c-7a5a66ad4e14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:36.529093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28e518-ac77-4af7-918c-7a5a66ad4e14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-cd28e518-ac77-4af7-918c-7a5a66ad4e14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:36.537645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:36.538637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:36.539424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:36.539424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:36.539424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:36.539424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:36.539424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:36.539424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:36.539424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:36.539424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:36.539424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:36.539424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:36.539424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:36.539424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:36.543239 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 247/485] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:36.552823 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28e518-ac77-4af7-918c-7a5a66ad4e14 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:36.648031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:36.674807 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28e518-ac77-4af7-918c-7a5a66ad4e14 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:36.713986 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ecf6f-db5c-48dc-943d-21eecbe6a33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:36.715017 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ecf6f-db5c-48dc-943d-21eecbe6a33e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:36.715544 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ecf6f-db5c-48dc-943d-21eecbe6a33e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:36.716003 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ecf6f-db5c-48dc-943d-21eecbe6a33e None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:36.716963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ecf6f-db5c-48dc-943d-21eecbe6a33e None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:36.717573 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ecf6f-db5c-48dc-943d-21eecbe6a33e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:36.719307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ecf6f-db5c-48dc-943d-21eecbe6a33e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:36.729964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 248/486] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:31:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:36.736392 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ecf6f-db5c-48dc-943d-21eecbe6a33e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:36.757541 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6221bc8-829f-42ae-a492-1ba1b5be990a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:36.843770 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54f99c-98fe-4614-9df3-d591f8c50596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:36.845201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54f99c-98fe-4614-9df3-d591f8c50596 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:36.845690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54f99c-98fe-4614-9df3-d591f8c50596 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:36.846358 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54f99c-98fe-4614-9df3-d591f8c50596 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:36.856264 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ecf6f-db5c-48dc-943d-21eecbe6a33e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:36.892481 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54f99c-98fe-4614-9df3-d591f8c50596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:36.897541 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45c394-11ea-49be-9b79-2785dba00251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:36.898835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45c394-11ea-49be-9b79-2785dba00251 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:36.899348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45c394-11ea-49be-9b79-2785dba00251 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:36.899805 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45c394-11ea-49be-9b79-2785dba00251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:36.910640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:36.914395 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45c394-11ea-49be-9b79-2785dba00251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:36.916487 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45c394-11ea-49be-9b79-2785dba00251 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-bd54f99c-98fe-4614-9df3-d591f8c50596 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:36.924532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:36.925501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:36.926308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:36.926308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:36.926308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:36.926308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:36.926308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:36.926308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:36.926308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:36.926308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:36.926308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:36.926308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:36.926308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:36.926308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:36.927375 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 239/487] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:36.937127 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54f99c-98fe-4614-9df3-d591f8c50596 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:36.941818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ab45c394-11ea-49be-9b79-2785dba00251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:36.941818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:36.941818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:36.941818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:36.941818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:36.941818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:36.941818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:36.941818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:36.941818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:36.941818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:36.941818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:36.941818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:36.941818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:36.941818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:36.941818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:36.942753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:36.943621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:36.943621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:36.943621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:36.943621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:36.952113 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 249/488] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:36.953761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45c394-11ea-49be-9b79-2785dba00251 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:37.000836 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:37.085679 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45c394-11ea-49be-9b79-2785dba00251 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:37.142535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226cdae-d0ba-4ae6-bec4-6ac15c56ab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:37.143465 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226cdae-d0ba-4ae6-bec4-6ac15c56ab92 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:37.143901 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226cdae-d0ba-4ae6-bec4-6ac15c56ab92 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:37.144193 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226cdae-d0ba-4ae6-bec4-6ac15c56ab92 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:37.145496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226cdae-d0ba-4ae6-bec4-6ac15c56ab92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:37.145816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226cdae-d0ba-4ae6-bec4-6ac15c56ab92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:37.147836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226cdae-d0ba-4ae6-bec4-6ac15c56ab92 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:37.169972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 250/489] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:37.172481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991f96c-4e60-4b48-b217-3cd41c0cbe8f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:37.173013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991f96c-4e60-4b48-b217-3cd41c0cbe8f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:37.173518 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991f96c-4e60-4b48-b217-3cd41c0cbe8f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:37.176730 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 251/490] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:37.178335 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991f96c-4e60-4b48-b217-3cd41c0cbe8f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:37.215260 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54f99c-98fe-4614-9df3-d591f8c50596 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:37.259725 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef0885-cb56-483b-98e9-07acd4f3546f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:37.260957 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef0885-cb56-483b-98e9-07acd4f3546f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:37.261248 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef0885-cb56-483b-98e9-07acd4f3546f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:37.261530 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef0885-cb56-483b-98e9-07acd4f3546f None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:37.262310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef0885-cb56-483b-98e9-07acd4f3546f None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:37.262676 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef0885-cb56-483b-98e9-07acd4f3546f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:37.264098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef0885-cb56-483b-98e9-07acd4f3546f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:37.275958 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 240/491] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:31:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:37.277303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6542949-6b6d-46eb-8a94-5ab5a5e94145 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:37.277600 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6542949-6b6d-46eb-8a94-5ab5a5e94145 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:37.277892 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6542949-6b6d-46eb-8a94-5ab5a5e94145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:37.302147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b6542949-6b6d-46eb-8a94-5ab5a5e94145 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:37.303806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b6542949-6b6d-46eb-8a94-5ab5a5e94145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:37.338895 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:37.386981 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991f96c-4e60-4b48-b217-3cd41c0cbe8f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:37.390714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 241/492] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:37.391621 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6542949-6b6d-46eb-8a94-5ab5a5e94145 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:37.408872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:37.497742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ed43d-1b95-468a-b966-14dcbdecbe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:37.499276 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ed43d-1b95-468a-b966-14dcbdecbe46 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:37.499862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ed43d-1b95-468a-b966-14dcbdecbe46 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:37.500457 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ed43d-1b95-468a-b966-14dcbdecbe46 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:37.516113 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ed43d-1b95-468a-b966-14dcbdecbe46 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:37.519483 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ed43d-1b95-468a-b966-14dcbdecbe46 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:37.526123 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6542949-6b6d-46eb-8a94-5ab5a5e94145 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-936ed43d-1b95-468a-b966-14dcbdecbe46 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:31:37.559013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:37.560027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:37.560997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:37.560997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:37.560997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:31:37.560997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:31:37.560997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:31:37.560997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:31:37.560997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:31:37.560997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:31:37.560997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:31:37.560997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:37.563674 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 252/493] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Jun 15 09:31:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:37.564741 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ed43d-1b95-468a-b966-14dcbdecbe46 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:37.579652 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5eb947-8af0-43f7-a47c-e1a2e9418b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:37.580850 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5eb947-8af0-43f7-a47c-e1a2e9418b9a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:37.581148 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5eb947-8af0-43f7-a47c-e1a2e9418b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:37.581431 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5eb947-8af0-43f7-a47c-e1a2e9418b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:37.594807 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5eb947-8af0-43f7-a47c-e1a2e9418b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:37.596374 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5eb947-8af0-43f7-a47c-e1a2e9418b9a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:37.621515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9f5eb947-8af0-43f7-a47c-e1a2e9418b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:37.621515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:37.621515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:37.621515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:37.621515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:37.621515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:37.621515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:37.621515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:37.621515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:37.621515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:37.621515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:37.621515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:37.621515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:37.621515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:37.621515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:37.623210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:37.624814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:37.624814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:37.624814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:37.624814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:37.627628 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 242/494] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:37.628924 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5eb947-8af0-43f7-a47c-e1a2e9418b9a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:37.712713 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:37.765854 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5eb947-8af0-43f7-a47c-e1a2e9418b9a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:37.768245 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ed43d-1b95-468a-b966-14dcbdecbe46 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:37.812554 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77855a-695b-421f-81de-6f4fb940f8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:37.813280 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77855a-695b-421f-81de-6f4fb940f8fe None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:37.813574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77855a-695b-421f-81de-6f4fb940f8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:37.813860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77855a-695b-421f-81de-6f4fb940f8fe None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:37.814774 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77855a-695b-421f-81de-6f4fb940f8fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:37.815095 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77855a-695b-421f-81de-6f4fb940f8fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:37.817036 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:37.817278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77855a-695b-421f-81de-6f4fb940f8fe None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:37.848368 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65954ada-b67d-4de9-9f31-31cf67d51434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:37.848368 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65954ada-b67d-4de9-9f31-31cf67d51434 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:37.848368 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65954ada-b67d-4de9-9f31-31cf67d51434 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:37.848368 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65954ada-b67d-4de9-9f31-31cf67d51434 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:37.866923 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 243/495] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Jun 15 09:31:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:37.868924 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77855a-695b-421f-81de-6f4fb940f8fe None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:37.876441 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65954ada-b67d-4de9-9f31-31cf67d51434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-65954ada-b67d-4de9-9f31-31cf67d51434 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:37.892628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:37.894671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:37.896403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:37.896403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:37.896403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:37.896403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:37.896403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:37.896403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:37.896403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:37.896403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:37.896403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:37.896403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:37.896403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:37.896403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:37.901334 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 253/496] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:37.903310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65954ada-b67d-4de9-9f31-31cf67d51434 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:38.020485 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77855a-695b-421f-81de-6f4fb940f8fe None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:38.062018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:38.077156 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48cb22-b960-4e83-8901-95acb4fe65a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:38.077928 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48cb22-b960-4e83-8901-95acb4fe65a8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:38.078387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48cb22-b960-4e83-8901-95acb4fe65a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:38.078795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48cb22-b960-4e83-8901-95acb4fe65a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:38.079686 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48cb22-b960-4e83-8901-95acb4fe65a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:38.080062 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48cb22-b960-4e83-8901-95acb4fe65a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:38.081648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48cb22-b960-4e83-8901-95acb4fe65a8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:38.082877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65954ada-b67d-4de9-9f31-31cf67d51434 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:38.096295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 244/497] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:38.097747 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48cb22-b960-4e83-8901-95acb4fe65a8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:38.125825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e2c53-f195-4deb-bb68-22cc4d8e7335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:38.126688 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e2c53-f195-4deb-bb68-22cc4d8e7335 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:38.127081 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e2c53-f195-4deb-bb68-22cc4d8e7335 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:38.127449 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e2c53-f195-4deb-bb68-22cc4d8e7335 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:38.180728 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:38.225879 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e2c53-f195-4deb-bb68-22cc4d8e7335 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:38.228524 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e2c53-f195-4deb-bb68-22cc4d8e7335 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:38.237938 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48cb22-b960-4e83-8901-95acb4fe65a8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:38.286360 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed29e4-e437-4672-a286-31c27c070b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:38.287136 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed29e4-e437-4672-a286-31c27c070b2d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:38.287513 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed29e4-e437-4672-a286-31c27c070b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:38.287884 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed29e4-e437-4672-a286-31c27c070b2d None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:38.288791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed29e4-e437-4672-a286-31c27c070b2d None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:38.289196 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed29e4-e437-4672-a286-31c27c070b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:38.290857 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed29e4-e437-4672-a286-31c27c070b2d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:38.303628 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 245/498] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:31:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:38.306298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff5dbe-9a75-418b-9703-9436e3cea556 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:38.306814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff5dbe-9a75-418b-9703-9436e3cea556 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:38.307269 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff5dbe-9a75-418b-9703-9436e3cea556 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:38.309651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 246/499] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:38.312234 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176efb9-b190-4aa7-adb2-b2fe6666fe04 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:38.312749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176efb9-b190-4aa7-adb2-b2fe6666fe04 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:38.313259 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176efb9-b190-4aa7-adb2-b2fe6666fe04 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:38.318563 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 247/500] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:38.318563 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176efb9-b190-4aa7-adb2-b2fe6666fe04 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:38.374604 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 254/501] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:38.376382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e2c53-f195-4deb-bb68-22cc4d8e7335 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:38.386435 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:38.464488 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176efb9-b190-4aa7-adb2-b2fe6666fe04 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:38.467762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:38.500565 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e2c53-f195-4deb-bb68-22cc4d8e7335 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:38.526851 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d84c1-c6e0-4fa6-9866-59a78db88577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:38.528086 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d84c1-c6e0-4fa6-9866-59a78db88577 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:38.528375 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d84c1-c6e0-4fa6-9866-59a78db88577 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:38.528668 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d84c1-c6e0-4fa6-9866-59a78db88577 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:38.540404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958856b4-af58-4c53-955a-ca982e9a33f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:38.541359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958856b4-af58-4c53-955a-ca982e9a33f0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:38.541500 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958856b4-af58-4c53-955a-ca982e9a33f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:38.541865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958856b4-af58-4c53-955a-ca982e9a33f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:38.543004 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d84c1-c6e0-4fa6-9866-59a78db88577 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:38.545948 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d84c1-c6e0-4fa6-9866-59a78db88577 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:38.557543 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958856b4-af58-4c53-955a-ca982e9a33f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:38.560290 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958856b4-af58-4c53-955a-ca982e9a33f0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ef7d84c1-c6e0-4fa6-9866-59a78db88577 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:31:38.565973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:38.567765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:38.569543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:38.569543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:38.569543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:31:38.569543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:31:38.569543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:31:38.569543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:31:38.569543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:31:38.569543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:31:38.569543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 09:31:38.569543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:38.569543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 248/502] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:38.569543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a1c5b-7032-4ac5-a5b0-7a7467be3d65 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:38.569543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a1c5b-7032-4ac5-a5b0-7a7467be3d65 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:38.571844 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a1c5b-7032-4ac5-a5b0-7a7467be3d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:38.586531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-958856b4-af58-4c53-955a-ca982e9a33f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:38.586531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:38.586531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:38.586531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:38.586531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:38.586531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:38.586531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:38.586531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:38.586531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:38.586531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:38.586531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:38.586531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:38.586531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:38.586531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:38.586531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:38.588282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:38.590100 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:38.590100 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:38.590100 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:38.590100 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:38.590100 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 255/503] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:38.590100 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262db7a-9c33-4c2b-a7a7-e10697a0b652 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:38.590100 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262db7a-9c33-4c2b-a7a7-e10697a0b652 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:38.590100 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262db7a-9c33-4c2b-a7a7-e10697a0b652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:38.598189 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-4f5a1c5b-7032-4ac5-a5b0-7a7467be3d65 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:38.599582 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4f5a1c5b-7032-4ac5-a5b0-7a7467be3d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:38.607586 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a262db7a-9c33-4c2b-a7a7-e10697a0b652 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:38.608847 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a262db7a-9c33-4c2b-a7a7-e10697a0b652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:38.685264 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 249/504] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:38.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a1c5b-7032-4ac5-a5b0-7a7467be3d65 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:38.707696 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 256/505] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:38.709131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262db7a-9c33-4c2b-a7a7-e10697a0b652 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:38.733378 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:38.796929 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:38.817826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a1c5b-7032-4ac5-a5b0-7a7467be3d65 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:38.854966 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262db7a-9c33-4c2b-a7a7-e10697a0b652 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:38.857041 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece247-51fc-4dd3-aa5c-ce055bafeeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:38.857860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece247-51fc-4dd3-aa5c-ce055bafeeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:38.858145 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece247-51fc-4dd3-aa5c-ce055bafeeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:38.858419 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece247-51fc-4dd3-aa5c-ce055bafeeb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:38.871292 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece247-51fc-4dd3-aa5c-ce055bafeeb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:38.872858 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece247-51fc-4dd3-aa5c-ce055bafeeb9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:38.896989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f8ece247-51fc-4dd3-aa5c-ce055bafeeb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:38.896989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:38.896989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:38.896989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:38.896989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:38.896989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:38.896989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:38.896989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:38.896989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:38.896989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:38.896989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:38.896989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:38.896989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:38.896989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:38.896989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:38.898785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:38.901334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:38.901334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:38.901334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:38.901334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:38.901334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 250/506] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:38.901334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece247-51fc-4dd3-aa5c-ce055bafeeb9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:38.906226 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b5c46-597b-4e8c-b73b-eda6c3a7c615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:38.907216 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b5c46-597b-4e8c-b73b-eda6c3a7c615 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:38.907675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b5c46-597b-4e8c-b73b-eda6c3a7c615 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:38.908127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b5c46-597b-4e8c-b73b-eda6c3a7c615 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:38.909658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b5c46-597b-4e8c-b73b-eda6c3a7c615 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:38.910346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b5c46-597b-4e8c-b73b-eda6c3a7c615 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:38.912965 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b5c46-597b-4e8c-b73b-eda6c3a7c615 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:38.979608 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 257/507] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Jun 15 09:31:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:38.981043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b5c46-597b-4e8c-b73b-eda6c3a7c615 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:39.027194 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:39.049859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece247-51fc-4dd3-aa5c-ce055bafeeb9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:39.106741 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339aa69-0eab-41fa-b2de-402a0e3d6108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:39.107800 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339aa69-0eab-41fa-b2de-402a0e3d6108 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:39.108257 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339aa69-0eab-41fa-b2de-402a0e3d6108 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:39.108706 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339aa69-0eab-41fa-b2de-402a0e3d6108 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:39.109901 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339aa69-0eab-41fa-b2de-402a0e3d6108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:39.110325 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339aa69-0eab-41fa-b2de-402a0e3d6108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:39.112766 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339aa69-0eab-41fa-b2de-402a0e3d6108 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:39.130531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b5c46-597b-4e8c-b73b-eda6c3a7c615 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:39.132073 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 251/508] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:39.133260 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339aa69-0eab-41fa-b2de-402a0e3d6108 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:39.160989 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:39.195169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4aebcc-b264-4550-8aa1-c62f91ef72f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:39.196643 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aebcc-b264-4550-8aa1-c62f91ef72f3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:39.197122 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aebcc-b264-4550-8aa1-c62f91ef72f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:39.197600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aebcc-b264-4550-8aa1-c62f91ef72f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:39.216638 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4aebcc-b264-4550-8aa1-c62f91ef72f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7b4aebcc-b264-4550-8aa1-c62f91ef72f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:39.232361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:39.233953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:39.235577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:39.235577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:39.235577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:39.235577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:39.235577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:39.235577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:39.235577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:39.235577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:39.235577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:39.235577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:39.235577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:39.235577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:39.235577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 258/509] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:39.236832 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4aebcc-b264-4550-8aa1-c62f91ef72f3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:39.265870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339aa69-0eab-41fa-b2de-402a0e3d6108 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:39.313506 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e845c-6926-4aa7-af48-e432bec6704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:39.314767 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e845c-6926-4aa7-af48-e432bec6704d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:39.315225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e845c-6926-4aa7-af48-e432bec6704d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:39.315692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e845c-6926-4aa7-af48-e432bec6704d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:39.333938 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e845c-6926-4aa7-af48-e432bec6704d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:39.335476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e845c-6926-4aa7-af48-e432bec6704d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:39.343436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:39.352870 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4aebcc-b264-4550-8aa1-c62f91ef72f3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:39.362608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-102e845c-6926-4aa7-af48-e432bec6704d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:39.362608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:39.362608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:39.362608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:39.362608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:39.362608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:39.362608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:39.362608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:39.362608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:39.362608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:39.362608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:39.362608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:39.362608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:39.362608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:39.362608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:39.363520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:39.364385 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:39.364385 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:39.364385 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:39.364385 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:39.364917 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 252/510] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:39.366350 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e845c-6926-4aa7-af48-e432bec6704d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:39.401234 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b25ce-50f5-4ebf-b0b8-824760b40314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:39.401920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b25ce-50f5-4ebf-b0b8-824760b40314 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:39.402216 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b25ce-50f5-4ebf-b0b8-824760b40314 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:39.402526 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b25ce-50f5-4ebf-b0b8-824760b40314 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:39.403283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b25ce-50f5-4ebf-b0b8-824760b40314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:39.403596 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b25ce-50f5-4ebf-b0b8-824760b40314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:39.405020 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b25ce-50f5-4ebf-b0b8-824760b40314 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:39.418424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 259/511] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:39.419398 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b25ce-50f5-4ebf-b0b8-824760b40314 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:39.453204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:39.513769 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e845c-6926-4aa7-af48-e432bec6704d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:39.540288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b25ce-50f5-4ebf-b0b8-824760b40314 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:39.561473 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84139083-bfa6-4483-bfac-552ce5ccc3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:39.562141 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139083-bfa6-4483-bfac-552ce5ccc3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:39.562425 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139083-bfa6-4483-bfac-552ce5ccc3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:39.562734 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139083-bfa6-4483-bfac-552ce5ccc3d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:39.597827 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c4255-4518-4dee-be9b-46bc35df0f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:39.599156 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c4255-4518-4dee-be9b-46bc35df0f59 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:39.599662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c4255-4518-4dee-be9b-46bc35df0f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:39.600179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c4255-4518-4dee-be9b-46bc35df0f59 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:39.611306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c4255-4518-4dee-be9b-46bc35df0f59 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:39.612802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c4255-4518-4dee-be9b-46bc35df0f59 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-810c4255-4518-4dee-be9b-46bc35df0f59 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:31:39.629223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:39.630218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:39.631169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:39.631169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:39.631169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:31:39.631169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:31:39.631169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:31:39.631169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:31:39.631169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:31:39.631169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:31:39.631169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 09:31:39.631169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:39.631169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 260/512] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:39.632462 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c4255-4518-4dee-be9b-46bc35df0f59 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:39.652035 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:39.656965 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84139083-bfa6-4483-bfac-552ce5ccc3d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:39.658657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84139083-bfa6-4483-bfac-552ce5ccc3d6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:39.779195 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 253/513] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:39.780115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84139083-bfa6-4483-bfac-552ce5ccc3d6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:39.788805 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:39.802187 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c4255-4518-4dee-be9b-46bc35df0f59 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:39.844893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22501f12-a3a8-4758-bb92-4e62691a5bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:39.845592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22501f12-a3a8-4758-bb92-4e62691a5bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:39.845894 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22501f12-a3a8-4758-bb92-4e62691a5bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:39.846182 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22501f12-a3a8-4758-bb92-4e62691a5bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:39.847017 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22501f12-a3a8-4758-bb92-4e62691a5bc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:39.847334 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22501f12-a3a8-4758-bb92-4e62691a5bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:39.848871 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22501f12-a3a8-4758-bb92-4e62691a5bc6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:39.859827 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 261/514] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:31:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:39.861207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22501f12-a3a8-4758-bb92-4e62691a5bc6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:39.945752 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:39.951960 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84139083-bfa6-4483-bfac-552ce5ccc3d6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:39.997749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083431d-a43c-4509-9286-a5f57a7b319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:39.998609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083431d-a43c-4509-9286-a5f57a7b319a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:39.999077 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083431d-a43c-4509-9286-a5f57a7b319a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:39.999507 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083431d-a43c-4509-9286-a5f57a7b319a None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:40.000352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083431d-a43c-4509-9286-a5f57a7b319a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:40.000738 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083431d-a43c-4509-9286-a5f57a7b319a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:40.002248 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083431d-a43c-4509-9286-a5f57a7b319a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:40.006542 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22501f12-a3a8-4758-bb92-4e62691a5bc6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:40.017660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 254/515] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:40.018855 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083431d-a43c-4509-9286-a5f57a7b319a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:40.059753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f33f94-22bf-438e-b862-ad51c0fb4918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:40.060862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f33f94-22bf-438e-b862-ad51c0fb4918 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:40.061287 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f33f94-22bf-438e-b862-ad51c0fb4918 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:40.061737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f33f94-22bf-438e-b862-ad51c0fb4918 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:40.073889 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f33f94-22bf-438e-b862-ad51c0fb4918 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:40.076528 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f33f94-22bf-438e-b862-ad51c0fb4918 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:40.097958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-55f33f94-22bf-438e-b862-ad51c0fb4918 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:40.097958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:40.097958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:40.097958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:40.097958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:40.097958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:40.097958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:40.097958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:40.097958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:40.097958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:40.097958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:40.097958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:40.097958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:31:40.097958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:31:40.097958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:40.099829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:40.101533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:31:40.101533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:31:40.101533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:31:40.101533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:31:40.101533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:31:40.101533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:31:40.101533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:40.101533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:40.101533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 262/516] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:40.101533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f33f94-22bf-438e-b862-ad51c0fb4918 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:40.120631 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:40.176271 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083431d-a43c-4509-9286-a5f57a7b319a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:40.228980 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c33a6-4bda-4dbe-823a-ba5dc51f03fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:40.230053 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c33a6-4bda-4dbe-823a-ba5dc51f03fa None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:40.230552 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c33a6-4bda-4dbe-823a-ba5dc51f03fa None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:40.231039 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c33a6-4bda-4dbe-823a-ba5dc51f03fa None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:40.232332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c33a6-4bda-4dbe-823a-ba5dc51f03fa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:40.232743 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c33a6-4bda-4dbe-823a-ba5dc51f03fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:40.234365 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c33a6-4bda-4dbe-823a-ba5dc51f03fa None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:40.246112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f33f94-22bf-438e-b862-ad51c0fb4918 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:40.257696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 255/517] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Jun 15 09:31:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:40.258939 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c33a6-4bda-4dbe-823a-ba5dc51f03fa None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:40.284306 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:40.295815 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f054c-273e-41e4-9a92-99248892f757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:40.296715 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f054c-273e-41e4-9a92-99248892f757 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:40.297127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f054c-273e-41e4-9a92-99248892f757 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:40.297496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f054c-273e-41e4-9a92-99248892f757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:40.311769 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f054c-273e-41e4-9a92-99248892f757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:40.314357 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f054c-273e-41e4-9a92-99248892f757 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:40.339883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d04f054c-273e-41e4-9a92-99248892f757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:40.339883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:40.339883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:40.339883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:40.339883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:40.339883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:40.339883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:40.339883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:40.339883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:40.339883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:40.339883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:40.339883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:40.339883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:40.339883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:40.339883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:40.341798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:40.343579 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:40.343579 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:40.343579 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:40.343579 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:40.343579 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 263/518] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:40.344095 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f054c-273e-41e4-9a92-99248892f757 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:40.409639 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c33a6-4bda-4dbe-823a-ba5dc51f03fa None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:40.442685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:40.457715 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ba5a4-1f53-4440-9964-3661f1c35b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:40.458678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ba5a4-1f53-4440-9964-3661f1c35b1d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:40.459084 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ba5a4-1f53-4440-9964-3661f1c35b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:40.459494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ba5a4-1f53-4440-9964-3661f1c35b1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:40.473014 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ba5a4-1f53-4440-9964-3661f1c35b1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:40.474965 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ba5a4-1f53-4440-9964-3661f1c35b1d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:40.491628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f054c-273e-41e4-9a92-99248892f757 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:40.505429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b97ba5a4-1f53-4440-9964-3661f1c35b1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:40.505429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:40.505429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:40.505429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:40.505429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:40.505429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:40.505429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:40.505429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:40.505429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:40.505429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:40.505429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:40.505429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:40.505429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:40.505429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:40.505429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:40.507353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:40.508915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:40.508915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:40.508915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:40.508915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:40.510680 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 256/519] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:40.512395 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ba5a4-1f53-4440-9964-3661f1c35b1d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:40.546206 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cd6a4-214a-401a-a8ee-1eb7061eeec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:40.547616 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cd6a4-214a-401a-a8ee-1eb7061eeec3 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:40.547616 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cd6a4-214a-401a-a8ee-1eb7061eeec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:40.548042 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cd6a4-214a-401a-a8ee-1eb7061eeec3 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:40.548874 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cd6a4-214a-401a-a8ee-1eb7061eeec3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:40.550429 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cd6a4-214a-401a-a8ee-1eb7061eeec3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:40.574429 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 264/520] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:31:40 2022] POST /identity/v3/users => generated 247 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:31:40.575467 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cd6a4-214a-401a-a8ee-1eb7061eeec3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:40.624231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:40.685681 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ba5a4-1f53-4440-9964-3661f1c35b1d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:40.731504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cd6a4-214a-401a-a8ee-1eb7061eeec3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:40.747868 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741c57a-3640-4ec2-a7ea-8f5b2b6dce1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:40.748698 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741c57a-3640-4ec2-a7ea-8f5b2b6dce1e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:40.749169 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741c57a-3640-4ec2-a7ea-8f5b2b6dce1e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:40.749610 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741c57a-3640-4ec2-a7ea-8f5b2b6dce1e None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:40.751114 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741c57a-3640-4ec2-a7ea-8f5b2b6dce1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:40.751810 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741c57a-3640-4ec2-a7ea-8f5b2b6dce1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:40.753732 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741c57a-3640-4ec2-a7ea-8f5b2b6dce1e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:40.762460 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:40.781969 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 257/521] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:31:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:40.782920 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741c57a-3640-4ec2-a7ea-8f5b2b6dce1e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:40.787712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf95c3f-7c64-4a0d-99bf-0205ad46a646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:40.788659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf95c3f-7c64-4a0d-99bf-0205ad46a646 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:40.789131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf95c3f-7c64-4a0d-99bf-0205ad46a646 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:40.789692 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf95c3f-7c64-4a0d-99bf-0205ad46a646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:40.894023 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf95c3f-7c64-4a0d-99bf-0205ad46a646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:40.896618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf95c3f-7c64-4a0d-99bf-0205ad46a646 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:40.930297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741c57a-3640-4ec2-a7ea-8f5b2b6dce1e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:40.977272 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:40.988313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c74f1-4c2c-47c0-b179-c4757537c448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:40.989039 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c74f1-4c2c-47c0-b179-c4757537c448 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:40.989327 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c74f1-4c2c-47c0-b179-c4757537c448 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:40.989603 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c74f1-4c2c-47c0-b179-c4757537c448 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:40.990349 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c74f1-4c2c-47c0-b179-c4757537c448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:40.990701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c74f1-4c2c-47c0-b179-c4757537c448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:40.992116 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c74f1-4c2c-47c0-b179-c4757537c448 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:41.005863 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 258/522] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:41.007315 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c74f1-4c2c-47c0-b179-c4757537c448 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:41.051557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 265/523] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:41.051557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf95c3f-7c64-4a0d-99bf-0205ad46a646 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:41.080700 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:41.160379 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c74f1-4c2c-47c0-b179-c4757537c448 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:41.200292 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e9541-f4f9-40f0-aa72-211bdba3cbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:41.201144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e9541-f4f9-40f0-aa72-211bdba3cbfd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:41.201548 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e9541-f4f9-40f0-aa72-211bdba3cbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:41.201962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e9541-f4f9-40f0-aa72-211bdba3cbfd None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:41.202934 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e9541-f4f9-40f0-aa72-211bdba3cbfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:41.203442 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e9541-f4f9-40f0-aa72-211bdba3cbfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:41.205053 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e9541-f4f9-40f0-aa72-211bdba3cbfd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:41.227388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 259/524] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:41.227388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e9541-f4f9-40f0-aa72-211bdba3cbfd None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:41.233677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf95c3f-7c64-4a0d-99bf-0205ad46a646 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:41.293111 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:41.300477 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486253d2-428f-4c7b-848a-7c58594d11d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:41.301666 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486253d2-428f-4c7b-848a-7c58594d11d4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:41.302185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486253d2-428f-4c7b-848a-7c58594d11d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:41.302646 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486253d2-428f-4c7b-848a-7c58594d11d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:41.304242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486253d2-428f-4c7b-848a-7c58594d11d4 None admin] RBAC: Adding query filter params (role.id=0ff0d3dcb5e448c3abc2470461490795, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=26dbaf7292444c8f9a6d45bfaf96763f) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:41.304676 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486253d2-428f-4c7b-848a-7c58594d11d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:41.307406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486253d2-428f-4c7b-848a-7c58594d11d4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:41.317809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 266/525] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:31:41 2022] GET /identity/v3/role_assignments?user.id=26dbaf7292444c8f9a6d45bfaf96763f&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=0ff0d3dcb5e448c3abc2470461490795 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:41.319341 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486253d2-428f-4c7b-848a-7c58594d11d4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:41.370311 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e9541-f4f9-40f0-aa72-211bdba3cbfd None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:41.426327 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbf6a1-6f2d-48ca-9a09-7be6e88f50e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:41.427876 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbf6a1-6f2d-48ca-9a09-7be6e88f50e2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:41.428483 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbf6a1-6f2d-48ca-9a09-7be6e88f50e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:41.429078 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbf6a1-6f2d-48ca-9a09-7be6e88f50e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:41.446040 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbf6a1-6f2d-48ca-9a09-7be6e88f50e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:41.449722 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbf6a1-6f2d-48ca-9a09-7be6e88f50e2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:41.482665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-d6dbf6a1-6f2d-48ca-9a09-7be6e88f50e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:41.482665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:41.482665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:41.482665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:41.482665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:41.482665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:41.482665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:41.482665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:41.482665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:41.482665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:41.482665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:41.482665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:41.482665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:31:41.482665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:31:41.482665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:41.484597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:41.486653 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:31:41.486653 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:31:41.486653 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:31:41.486653 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:31:41.486653 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:31:41.486653 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:31:41.486653 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:41.486653 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:41.489964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 260/526] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:41.492083 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbf6a1-6f2d-48ca-9a09-7be6e88f50e2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:41.559495 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:41.575183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486253d2-428f-4c7b-848a-7c58594d11d4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:41.669521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dcf2d-534f-4f8a-9e6b-035154fe9b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:41.670953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dcf2d-534f-4f8a-9e6b-035154fe9b20 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:41.671466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dcf2d-534f-4f8a-9e6b-035154fe9b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:41.671958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dcf2d-534f-4f8a-9e6b-035154fe9b20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:41.690878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbf6a1-6f2d-48ca-9a09-7be6e88f50e2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:41.692903 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dcf2d-534f-4f8a-9e6b-035154fe9b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:41.695827 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dcf2d-534f-4f8a-9e6b-035154fe9b20 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:41.707384 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:41.731793 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efd1a7-9161-4574-9535-db20abd61631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:41.732836 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efd1a7-9161-4574-9535-db20abd61631 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:41.732955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c60dcf2d-534f-4f8a-9e6b-035154fe9b20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:41.732955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:41.732955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:41.732955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:41.732955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:41.732955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:41.732955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:41.732955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:41.732955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:41.732955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:41.732955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:41.732955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:41.732955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:41.732955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:41.732955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:41.734052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:41.735166 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:41.735166 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:41.735166 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:41.735166 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:41.735442 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efd1a7-9161-4574-9535-db20abd61631 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:41.735442 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efd1a7-9161-4574-9535-db20abd61631 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:41.735603 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 267/527] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:41.737053 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dcf2d-534f-4f8a-9e6b-035154fe9b20 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:41.747277 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efd1a7-9161-4574-9535-db20abd61631 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:41.749099 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efd1a7-9161-4574-9535-db20abd61631 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-73efd1a7-9161-4574-9535-db20abd61631 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:31:41.765976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:41.767251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:41.768152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:41.768152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:41.768152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:31:41.768152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:31:41.768152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:31:41.768152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:31:41.768152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:31:41.768152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:31:41.768152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 09:31:41.768152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:41.770715 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 261/528] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:41.772210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efd1a7-9161-4574-9535-db20abd61631 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:41.893557 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efd1a7-9161-4574-9535-db20abd61631 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:41.936223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dcf2d-534f-4f8a-9e6b-035154fe9b20 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:41.937046 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483d7aa-08ff-4cc2-9eba-365ebc4e2bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:41.937892 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483d7aa-08ff-4cc2-9eba-365ebc4e2bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:41.938367 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483d7aa-08ff-4cc2-9eba-365ebc4e2bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:41.938853 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483d7aa-08ff-4cc2-9eba-365ebc4e2bd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:41.939883 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483d7aa-08ff-4cc2-9eba-365ebc4e2bd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:41.940389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483d7aa-08ff-4cc2-9eba-365ebc4e2bd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:41.942040 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483d7aa-08ff-4cc2-9eba-365ebc4e2bd7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:41.956956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 262/529] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:41.958142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483d7aa-08ff-4cc2-9eba-365ebc4e2bd7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:41.991519 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:42.004484 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d42aed-af0c-4819-aa49-9cd53275d033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:42.005628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d42aed-af0c-4819-aa49-9cd53275d033 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:42.006119 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d42aed-af0c-4819-aa49-9cd53275d033 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:42.006666 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d42aed-af0c-4819-aa49-9cd53275d033 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:42.008217 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d42aed-af0c-4819-aa49-9cd53275d033 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:42.008775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d42aed-af0c-4819-aa49-9cd53275d033 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:42.011709 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d42aed-af0c-4819-aa49-9cd53275d033 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:42.032317 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:42.052921 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 268/530] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:31:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:42.052921 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d42aed-af0c-4819-aa49-9cd53275d033 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:42.086753 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483d7aa-08ff-4cc2-9eba-365ebc4e2bd7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:42.127599 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1ab2c-78d0-4231-b591-4b72530285d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:42.128576 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1ab2c-78d0-4231-b591-4b72530285d9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:42.129142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1ab2c-78d0-4231-b591-4b72530285d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:42.129561 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1ab2c-78d0-4231-b591-4b72530285d9 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:42.130617 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1ab2c-78d0-4231-b591-4b72530285d9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:42.131076 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1ab2c-78d0-4231-b591-4b72530285d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:42.132820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1ab2c-78d0-4231-b591-4b72530285d9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:42.154377 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 263/531] 10.222.0.45 () {56 vars in 1139 bytes} [Wed Jun 15 09:31:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:42.155479 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1ab2c-78d0-4231-b591-4b72530285d9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:42.247847 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d42aed-af0c-4819-aa49-9cd53275d033 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:42.255757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:42.277715 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1ab2c-78d0-4231-b591-4b72530285d9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:42.322453 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150dced-8261-4295-899e-5ef8502b52d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:42.324170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150dced-8261-4295-899e-5ef8502b52d3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:42.324672 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150dced-8261-4295-899e-5ef8502b52d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:42.325166 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150dced-8261-4295-899e-5ef8502b52d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:42.341192 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150dced-8261-4295-899e-5ef8502b52d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:42.343937 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150dced-8261-4295-899e-5ef8502b52d3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:42.355422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29cfb4-5ca1-40b1-8045-8b643f9f3a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:42.357564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29cfb4-5ca1-40b1-8045-8b643f9f3a0a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:42.358335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29cfb4-5ca1-40b1-8045-8b643f9f3a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:42.359128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29cfb4-5ca1-40b1-8045-8b643f9f3a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:42.361009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29cfb4-5ca1-40b1-8045-8b643f9f3a0a None admin] RBAC: Adding query filter params (role.id=0ff0d3dcb5e448c3abc2470461490795, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=e6608bed12f746b89527a80b05459e5e) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:42.361862 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29cfb4-5ca1-40b1-8045-8b643f9f3a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:42.365021 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad29cfb4-5ca1-40b1-8045-8b643f9f3a0a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:42.372027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a150dced-8261-4295-899e-5ef8502b52d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:42.372027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:42.372027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:42.372027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:42.372027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:42.372027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:42.372027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:42.372027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:42.372027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:42.372027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:42.372027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:42.372027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:42.372027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:31:42.372027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:31:42.372027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:42.373611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:42.375240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:31:42.375240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:31:42.375240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:31:42.375240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:31:42.375240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:31:42.375240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:31:42.375240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:42.375240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:42.375240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 269/532] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:42.376180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150dced-8261-4295-899e-5ef8502b52d3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:42.382663 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 264/533] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:31:42 2022] GET /identity/v3/role_assignments?user.id=e6608bed12f746b89527a80b05459e5e&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=0ff0d3dcb5e448c3abc2470461490795 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:42.389723 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29cfb4-5ca1-40b1-8045-8b643f9f3a0a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:42.495583 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:42.585464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150dced-8261-4295-899e-5ef8502b52d3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:42.656683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf2ebe-dbb4-41ea-b0b3-47b916baf8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:42.657939 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2ebe-dbb4-41ea-b0b3-47b916baf8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:42.658567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2ebe-dbb4-41ea-b0b3-47b916baf8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:42.659168 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2ebe-dbb4-41ea-b0b3-47b916baf8c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:42.744311 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29cfb4-5ca1-40b1-8045-8b643f9f3a0a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:42.829951 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf2ebe-dbb4-41ea-b0b3-47b916baf8c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:42.833246 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf2ebe-dbb4-41ea-b0b3-47b916baf8c5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:42.858193 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75d004-191e-46b2-815f-f3bdc1c64bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:42.859416 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75d004-191e-46b2-815f-f3bdc1c64bad None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:42.860071 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75d004-191e-46b2-815f-f3bdc1c64bad None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:42.860571 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75d004-191e-46b2-815f-f3bdc1c64bad None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:42.862296 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75d004-191e-46b2-815f-f3bdc1c64bad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:42.862879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75d004-191e-46b2-815f-f3bdc1c64bad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:42.865649 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75d004-191e-46b2-815f-f3bdc1c64bad None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:42.903680 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 265/534] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:31:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 515 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:42.912040 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75d004-191e-46b2-815f-f3bdc1c64bad None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:42.941069 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:42.982850 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:43.104502 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 270/535] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:43.106456 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1adc65-3733-48dc-b661-823cf11fe2b6 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:43.107040 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1adc65-3733-48dc-b661-823cf11fe2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:43.107559 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1adc65-3733-48dc-b661-823cf11fe2b6 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:43.113891 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 271/536] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:43.115343 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1adc65-3733-48dc-b661-823cf11fe2b6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:43.172889 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75d004-191e-46b2-815f-f3bdc1c64bad None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:43.233047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1adc65-3733-48dc-b661-823cf11fe2b6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:43.242098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9989a-0149-4a7f-be1d-6000a7e29669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:43.243963 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9989a-0149-4a7f-be1d-6000a7e29669 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:43.244530 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9989a-0149-4a7f-be1d-6000a7e29669 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:43.245030 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9989a-0149-4a7f-be1d-6000a7e29669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:43.246807 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9989a-0149-4a7f-be1d-6000a7e29669 None admin] RBAC: Adding query filter params (role.id=0ff0d3dcb5e448c3abc2470461490795, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=303c1175b5d24b0d8a929c7905a4c17c) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:43.247377 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9989a-0149-4a7f-be1d-6000a7e29669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:43.250227 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9989a-0149-4a7f-be1d-6000a7e29669 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:43.262534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 266/537] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:31:42 2022] GET /identity/v3/role_assignments?user.id=303c1175b5d24b0d8a929c7905a4c17c&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=0ff0d3dcb5e448c3abc2470461490795 => generated 259 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:43.265035 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cb917-734c-460b-80c1-65609e31bbe3 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:43.265510 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cb917-734c-460b-80c1-65609e31bbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:43.265950 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cb917-734c-460b-80c1-65609e31bbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:43.277689 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310219f5-1f91-4bec-bfdf-7e003ae095e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:43.279015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310219f5-1f91-4bec-bfdf-7e003ae095e3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:43.279513 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310219f5-1f91-4bec-bfdf-7e003ae095e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:43.280003 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310219f5-1f91-4bec-bfdf-7e003ae095e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:43.296715 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-477cb917-734c-460b-80c1-65609e31bbe3 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:43.298961 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-477cb917-734c-460b-80c1-65609e31bbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:43.300662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310219f5-1f91-4bec-bfdf-7e003ae095e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:43.310734 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310219f5-1f91-4bec-bfdf-7e003ae095e3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:43.342533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-310219f5-1f91-4bec-bfdf-7e003ae095e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:43.342533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:43.342533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:43.342533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:43.342533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:43.342533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:43.342533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:43.342533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:43.342533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:43.342533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:43.342533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:43.342533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:43.342533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:43.342533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:43.342533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:43.343892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:43.344732 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:43.344732 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:43.344732 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:43.344732 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:43.347028 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 272/538] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:43.356561 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310219f5-1f91-4bec-bfdf-7e003ae095e3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:43.395804 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:43.445347 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 267/539] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:43.471633 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cb917-734c-460b-80c1-65609e31bbe3 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:43.494935 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:43.681609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cb917-734c-460b-80c1-65609e31bbe3 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:43.682076 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310219f5-1f91-4bec-bfdf-7e003ae095e3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:43.751991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e7029-85f8-488f-bc9a-a3d8a2d57e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:43.753442 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e7029-85f8-488f-bc9a-a3d8a2d57e99 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:43.753945 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e7029-85f8-488f-bc9a-a3d8a2d57e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:43.754590 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e7029-85f8-488f-bc9a-a3d8a2d57e99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:43.768299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9102b-90ae-40a1-b145-72e83f17aa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:43.769441 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9102b-90ae-40a1-b145-72e83f17aa96 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:43.769937 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9102b-90ae-40a1-b145-72e83f17aa96 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:43.770450 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9102b-90ae-40a1-b145-72e83f17aa96 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:43.771432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9102b-90ae-40a1-b145-72e83f17aa96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:43.771951 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9102b-90ae-40a1-b145-72e83f17aa96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:43.773556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9102b-90ae-40a1-b145-72e83f17aa96 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:43.775768 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e7029-85f8-488f-bc9a-a3d8a2d57e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:43.787510 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 273/540] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-515e7029-85f8-488f-bc9a-a3d8a2d57e99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:43.792436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:43.793359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:43.794153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:43.794153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:43.794153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:43.794153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:43.794153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:43.794153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:43.794153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:43.794153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:43.794153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:43.794153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:43.794153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:43.794153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:43.798524 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 268/541] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:43.799842 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9102b-90ae-40a1-b145-72e83f17aa96 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:43.816439 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e7029-85f8-488f-bc9a-a3d8a2d57e99 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:43.931075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:43.974914 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:43.987579 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9102b-90ae-40a1-b145-72e83f17aa96 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:44.041494 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc01729-bd42-482d-ad05-a64cf2b903f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:44.043708 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc01729-bd42-482d-ad05-a64cf2b903f2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:44.047234 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc01729-bd42-482d-ad05-a64cf2b903f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:44.047818 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc01729-bd42-482d-ad05-a64cf2b903f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:44.061323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc01729-bd42-482d-ad05-a64cf2b903f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:44.064216 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc01729-bd42-482d-ad05-a64cf2b903f2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:44.081345 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e7029-85f8-488f-bc9a-a3d8a2d57e99 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:44.097297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5fc01729-bd42-482d-ad05-a64cf2b903f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:44.097297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:44.097297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:44.097297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:44.097297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:44.097297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:44.097297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:44.097297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:44.097297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:44.097297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:44.097297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:44.097297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:44.097297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:31:44.097297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:31:44.097297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:44.098219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:44.099093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:31:44.099093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:31:44.099093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:31:44.099093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:31:44.099093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:31:44.099093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:31:44.099093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:44.099093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:44.105343 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 274/542] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:44.113511 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc01729-bd42-482d-ad05-a64cf2b903f2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:44.174983 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83266f0-bee6-42a1-8b07-7e88b6c1f139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:44.177092 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83266f0-bee6-42a1-8b07-7e88b6c1f139 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:44.179714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83266f0-bee6-42a1-8b07-7e88b6c1f139 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:44.180430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83266f0-bee6-42a1-8b07-7e88b6c1f139 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:44.181924 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83266f0-bee6-42a1-8b07-7e88b6c1f139 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:44.183214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83266f0-bee6-42a1-8b07-7e88b6c1f139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:44.186040 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83266f0-bee6-42a1-8b07-7e88b6c1f139 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:44.220642 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 269/543] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:31:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:44.228413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83266f0-bee6-42a1-8b07-7e88b6c1f139 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:44.316719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc01729-bd42-482d-ad05-a64cf2b903f2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:44.391049 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:44.403185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf866bde-9bc9-4f58-a32d-9452f5e4e4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:44.404311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf866bde-9bc9-4f58-a32d-9452f5e4e4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:44.404804 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf866bde-9bc9-4f58-a32d-9452f5e4e4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:44.405314 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf866bde-9bc9-4f58-a32d-9452f5e4e4f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:44.406491 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf866bde-9bc9-4f58-a32d-9452f5e4e4f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:44.407248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf866bde-9bc9-4f58-a32d-9452f5e4e4f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:44.409003 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf866bde-9bc9-4f58-a32d-9452f5e4e4f7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:44.438191 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 275/544] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:31:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:44.443402 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf866bde-9bc9-4f58-a32d-9452f5e4e4f7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:44.468560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83266f0-bee6-42a1-8b07-7e88b6c1f139 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:44.537703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:44.558530 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6a246-1ae0-400e-80e8-0030f50681ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:44.558530 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6a246-1ae0-400e-80e8-0030f50681ba None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:44.558530 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6a246-1ae0-400e-80e8-0030f50681ba None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:44.558530 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6a246-1ae0-400e-80e8-0030f50681ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:44.581659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6a246-1ae0-400e-80e8-0030f50681ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:44.583207 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6a246-1ae0-400e-80e8-0030f50681ba None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:44.620334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7de6a246-1ae0-400e-80e8-0030f50681ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:44.620334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:44.620334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:44.620334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:44.620334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:44.620334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:44.620334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:44.620334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:44.620334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:44.620334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:44.620334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:44.620334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:44.620334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:44.620334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:44.620334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:44.622033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:44.623784 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:44.623784 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:44.623784 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:44.623784 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:44.623784 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 270/545] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:44.631568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6a246-1ae0-400e-80e8-0030f50681ba None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:44.670964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf866bde-9bc9-4f58-a32d-9452f5e4e4f7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:44.710756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e8498-09f2-44e5-b157-8e87196f684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:44.711211 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e8498-09f2-44e5-b157-8e87196f684d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:44.711435 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e8498-09f2-44e5-b157-8e87196f684d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:44.711714 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e8498-09f2-44e5-b157-8e87196f684d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:44.712691 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e8498-09f2-44e5-b157-8e87196f684d None admin] RBAC: Adding query filter params (role.id=0ff0d3dcb5e448c3abc2470461490795, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=68a7bf928d4e46c182e22687befcdea8) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:44.713014 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e8498-09f2-44e5-b157-8e87196f684d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:44.714546 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e8498-09f2-44e5-b157-8e87196f684d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:44.721736 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 276/546] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:31:44 2022] GET /identity/v3/role_assignments?user.id=68a7bf928d4e46c182e22687befcdea8&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=0ff0d3dcb5e448c3abc2470461490795 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:44.879456 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6a246-1ae0-400e-80e8-0030f50681ba None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:44.936681 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72955d1e-7065-47e6-b17b-3925bffe11f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:44.937396 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72955d1e-7065-47e6-b17b-3925bffe11f3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:44.937688 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72955d1e-7065-47e6-b17b-3925bffe11f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:44.937970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72955d1e-7065-47e6-b17b-3925bffe11f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:44.938777 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72955d1e-7065-47e6-b17b-3925bffe11f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:44.939083 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72955d1e-7065-47e6-b17b-3925bffe11f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:44.940537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72955d1e-7065-47e6-b17b-3925bffe11f3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:44.960808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 271/547] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:44.967255 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e8498-09f2-44e5-b157-8e87196f684d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:45.033240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:45.086785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e8498-09f2-44e5-b157-8e87196f684d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:45.126016 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c4947-c45c-426f-aca5-eb71126b7f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:45.126881 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c4947-c45c-426f-aca5-eb71126b7f83 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:45.127170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c4947-c45c-426f-aca5-eb71126b7f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:45.127455 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c4947-c45c-426f-aca5-eb71126b7f83 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:45.136407 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c4947-c45c-426f-aca5-eb71126b7f83 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:45.137785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c4947-c45c-426f-aca5-eb71126b7f83 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-791c4947-c45c-426f-aca5-eb71126b7f83 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:31:45.154224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:45.157039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:45.160174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:45.160174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:45.160174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:31:45.160174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:31:45.160174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:31:45.160174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:31:45.160174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:31:45.160174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:31:45.160174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 09:31:45.160174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:45.160174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 277/548] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:31:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:45.162436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72955d1e-7065-47e6-b17b-3925bffe11f3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:45.270936 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:45.350830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a42267-fc98-4273-a336-6f0251efeb57 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:45.351499 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a42267-fc98-4273-a336-6f0251efeb57 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:45.352016 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a42267-fc98-4273-a336-6f0251efeb57 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:45.354925 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 278/549] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:45.364084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8a48a-a711-48d9-b98b-03cf46e1f358 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:45.364740 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8a48a-a711-48d9-b98b-03cf46e1f358 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:45.365225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8a48a-a711-48d9-b98b-03cf46e1f358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:45.372735 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72955d1e-7065-47e6-b17b-3925bffe11f3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:45.405019 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e4e8a48a-a711-48d9-b98b-03cf46e1f358 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:45.405019 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e4e8a48a-a711-48d9-b98b-03cf46e1f358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:45.424692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18e556-7a70-4149-a5d0-c26a657694f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:45.434528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18e556-7a70-4149-a5d0-c26a657694f0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:45.435355 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18e556-7a70-4149-a5d0-c26a657694f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:45.435963 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18e556-7a70-4149-a5d0-c26a657694f0 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:45.437069 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18e556-7a70-4149-a5d0-c26a657694f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:45.437598 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18e556-7a70-4149-a5d0-c26a657694f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:45.439619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18e556-7a70-4149-a5d0-c26a657694f0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:45.472319 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 272/550] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Jun 15 09:31:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:45.481831 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18e556-7a70-4149-a5d0-c26a657694f0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:45.493881 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 279/551] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:45.531920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8a48a-a711-48d9-b98b-03cf46e1f358 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:45.610790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:45.701708 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8a48a-a711-48d9-b98b-03cf46e1f358 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:45.724370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:45.744932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2650a-faea-4521-b9f8-e8af6649d1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:45.746016 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2650a-faea-4521-b9f8-e8af6649d1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:45.746660 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2650a-faea-4521-b9f8-e8af6649d1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:45.747090 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2650a-faea-4521-b9f8-e8af6649d1a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:45.753937 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18e556-7a70-4149-a5d0-c26a657694f0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:45.760182 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2650a-faea-4521-b9f8-e8af6649d1a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-dfa2650a-faea-4521-b9f8-e8af6649d1a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:45.769220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:45.770379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:45.771399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:45.771399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:45.771399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:45.771399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:45.771399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:45.771399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:45.771399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:45.771399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:45.771399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:45.771399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:45.771399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:45.771399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:45.774060 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 280/552] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:45.780393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2650a-faea-4521-b9f8-e8af6649d1a5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:45.841518 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b07fb-5085-4d96-92d0-5bc04eb92f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:45.842581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b07fb-5085-4d96-92d0-5bc04eb92f6e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:45.844508 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b07fb-5085-4d96-92d0-5bc04eb92f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:45.844995 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b07fb-5085-4d96-92d0-5bc04eb92f6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:46.022951 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2650a-faea-4521-b9f8-e8af6649d1a5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:46.025871 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:46.065977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001333f-4bab-4e23-8181-d44dc82a13b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:46.069833 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001333f-4bab-4e23-8181-d44dc82a13b8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:46.070189 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001333f-4bab-4e23-8181-d44dc82a13b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:46.070479 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001333f-4bab-4e23-8181-d44dc82a13b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:46.071866 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001333f-4bab-4e23-8181-d44dc82a13b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:46.072183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001333f-4bab-4e23-8181-d44dc82a13b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:46.073627 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001333f-4bab-4e23-8181-d44dc82a13b8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:46.079475 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b07fb-5085-4d96-92d0-5bc04eb92f6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:46.080988 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b07fb-5085-4d96-92d0-5bc04eb92f6e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:46.106982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 281/553] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:31:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:46.108529 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001333f-4bab-4e23-8181-d44dc82a13b8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:46.283959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001333f-4bab-4e23-8181-d44dc82a13b8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:46.323753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2b500-3943-4f87-a2a7-f3737eced666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:46.324905 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2b500-3943-4f87-a2a7-f3737eced666 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:46.325390 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2b500-3943-4f87-a2a7-f3737eced666 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:46.325826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2b500-3943-4f87-a2a7-f3737eced666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:46.338667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2b500-3943-4f87-a2a7-f3737eced666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:46.340504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2b500-3943-4f87-a2a7-f3737eced666 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:46.350912 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:46.360865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-40c2b500-3943-4f87-a2a7-f3737eced666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:46.360865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:46.360865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:46.360865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:46.360865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:46.360865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:46.360865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:46.360865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:46.360865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:46.360865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:46.360865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:46.360865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:46.360865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:46.360865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:46.360865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:46.362005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:46.363019 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:46.363019 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:46.363019 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:46.363019 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:46.364111 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 282/554] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:46.370683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2b500-3943-4f87-a2a7-f3737eced666 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:46.375810 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 273/555] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 894 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:46.384230 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b07fb-5085-4d96-92d0-5bc04eb92f6e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:46.393551 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:46.494101 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2b500-3943-4f87-a2a7-f3737eced666 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:46.538487 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4853c1e-0dd5-4ad4-a33e-fb3c47fbab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:46.539485 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4853c1e-0dd5-4ad4-a33e-fb3c47fbab64 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:46.544845 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4853c1e-0dd5-4ad4-a33e-fb3c47fbab64 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:46.545416 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4853c1e-0dd5-4ad4-a33e-fb3c47fbab64 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:46.546747 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4853c1e-0dd5-4ad4-a33e-fb3c47fbab64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:46.547251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4853c1e-0dd5-4ad4-a33e-fb3c47fbab64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:46.552092 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4853c1e-0dd5-4ad4-a33e-fb3c47fbab64 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:46.573802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 283/556] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:46.577131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84e9bc-1fa4-4834-bc19-7c97c198ef85 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:46.577683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84e9bc-1fa4-4834-bc19-7c97c198ef85 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:46.578209 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84e9bc-1fa4-4834-bc19-7c97c198ef85 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:46.581691 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 284/557] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:46.583582 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84e9bc-1fa4-4834-bc19-7c97c198ef85 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:46.598183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b07fb-5085-4d96-92d0-5bc04eb92f6e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:46.669723 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467e3af-96a7-4828-81d7-e675024b5b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:46.671591 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467e3af-96a7-4828-81d7-e675024b5b24 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:46.672058 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467e3af-96a7-4828-81d7-e675024b5b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:46.672523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467e3af-96a7-4828-81d7-e675024b5b24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:46.694828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467e3af-96a7-4828-81d7-e675024b5b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:46.698251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467e3af-96a7-4828-81d7-e675024b5b24 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:46.741115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3467e3af-96a7-4828-81d7-e675024b5b24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:46.741115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:46.741115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:46.741115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:46.741115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:46.741115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:46.741115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:46.741115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:46.741115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:46.741115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:46.741115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:46.741115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:46.741115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:46.741115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:46.741115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:46.742581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:46.743548 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:46.743548 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:46.743548 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:46.743548 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:46.743967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 274/558] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:46.747121 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053dcff-32a3-4af6-85d6-6ac46441e466 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:46.747571 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053dcff-32a3-4af6-85d6-6ac46441e466 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:46.748180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053dcff-32a3-4af6-85d6-6ac46441e466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:46.749332 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:46.783193 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0053dcff-32a3-4af6-85d6-6ac46441e466 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:46.786970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0053dcff-32a3-4af6-85d6-6ac46441e466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:46.804129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84e9bc-1fa4-4834-bc19-7c97c198ef85 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:46.867143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:46.870643 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b26ae4-209a-4e18-ba4a-d7d2cd081890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:46.871798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b26ae4-209a-4e18-ba4a-d7d2cd081890 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:46.872911 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b26ae4-209a-4e18-ba4a-d7d2cd081890 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:46.873227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b26ae4-209a-4e18-ba4a-d7d2cd081890 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:46.881823 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b26ae4-209a-4e18-ba4a-d7d2cd081890 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:46.883342 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b26ae4-209a-4e18-ba4a-d7d2cd081890 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a9b26ae4-209a-4e18-ba4a-d7d2cd081890 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:31:46.900779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:46.901843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:46.902898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:46.902898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:46.902898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:31:46.902898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:31:46.902898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:31:46.902898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:31:46.902898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:31:46.902898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:31:46.902898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:31:46.902898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:46.902898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 285/559] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Jun 15 09:31:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:46.902898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b26ae4-209a-4e18-ba4a-d7d2cd081890 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:46.922186 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 275/560] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:46.924653 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6918dd1-4170-4aa2-95a2-c53413e70574 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:46.925118 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6918dd1-4170-4aa2-95a2-c53413e70574 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:46.925564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6918dd1-4170-4aa2-95a2-c53413e70574 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:46.932548 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 276/561] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:46.932548 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6918dd1-4170-4aa2-95a2-c53413e70574 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:47.032779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b26ae4-209a-4e18-ba4a-d7d2cd081890 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:47.072793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca3ca1-efa7-4c70-9638-29bb409b66ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:47.073393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca3ca1-efa7-4c70-9638-29bb409b66ce None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:47.073727 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca3ca1-efa7-4c70-9638-29bb409b66ce None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:47.073962 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca3ca1-efa7-4c70-9638-29bb409b66ce None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:47.074736 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca3ca1-efa7-4c70-9638-29bb409b66ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:47.075053 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca3ca1-efa7-4c70-9638-29bb409b66ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:47.076469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca3ca1-efa7-4c70-9638-29bb409b66ce None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:47.083803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:47.095541 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 286/562] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:47.096892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346ca25-f6a3-4e01-a266-85167dabc9ae None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:47.097187 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346ca25-f6a3-4e01-a266-85167dabc9ae None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:47.097475 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346ca25-f6a3-4e01-a266-85167dabc9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:47.115367 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3346ca25-f6a3-4e01-a266-85167dabc9ae None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:47.116783 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3346ca25-f6a3-4e01-a266-85167dabc9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:47.119184 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6918dd1-4170-4aa2-95a2-c53413e70574 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:47.184735 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349b1bb-8227-4c3e-af18-0e9444762d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:47.185957 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349b1bb-8227-4c3e-af18-0e9444762d16 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:47.186457 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349b1bb-8227-4c3e-af18-0e9444762d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:47.187131 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349b1bb-8227-4c3e-af18-0e9444762d16 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:47.188318 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349b1bb-8227-4c3e-af18-0e9444762d16 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:47.188770 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349b1bb-8227-4c3e-af18-0e9444762d16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:47.190836 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349b1bb-8227-4c3e-af18-0e9444762d16 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:47.210528 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 287/563] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:47.210528 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346ca25-f6a3-4e01-a266-85167dabc9ae None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:47.239305 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 277/564] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Jun 15 09:31:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:47.241345 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349b1bb-8227-4c3e-af18-0e9444762d16 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:47.287266 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:47.347006 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346ca25-f6a3-4e01-a266-85167dabc9ae None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:47.374077 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349b1bb-8227-4c3e-af18-0e9444762d16 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:47.384454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:47.395759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1adaf6-0e3e-4f01-a1c3-7bcfe982ea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:47.396614 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1adaf6-0e3e-4f01-a1c3-7bcfe982ea3e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:47.396973 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1adaf6-0e3e-4f01-a1c3-7bcfe982ea3e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:47.397258 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1adaf6-0e3e-4f01-a1c3-7bcfe982ea3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:47.411112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1adaf6-0e3e-4f01-a1c3-7bcfe982ea3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6a1adaf6-0e3e-4f01-a1c3-7bcfe982ea3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:47.419297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:47.420707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:47.422419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:47.422419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:47.422419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:47.422419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:47.422419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:47.422419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:47.422419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:47.422419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:47.422419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:47.422419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:47.422419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:47.422419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:47.422419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 288/565] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:47.422419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1adaf6-0e3e-4f01-a1c3-7bcfe982ea3e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:47.431599 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d572b7c-f1ee-4c30-aaef-ca3101a7fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:47.432425 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d572b7c-f1ee-4c30-aaef-ca3101a7fcf0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:47.432711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d572b7c-f1ee-4c30-aaef-ca3101a7fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:47.432992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d572b7c-f1ee-4c30-aaef-ca3101a7fcf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:47.440721 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d572b7c-f1ee-4c30-aaef-ca3101a7fcf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:47.442217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d572b7c-f1ee-4c30-aaef-ca3101a7fcf0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:47.457830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9d572b7c-f1ee-4c30-aaef-ca3101a7fcf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:47.457830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:47.457830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:47.457830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:47.457830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:47.457830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:47.457830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:47.457830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:47.457830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:47.457830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:47.457830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:47.457830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:47.457830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:31:47.457830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:31:47.457830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:47.459061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:47.460771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:31:47.460771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:31:47.460771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:31:47.460771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:31:47.460771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:31:47.460771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:31:47.460771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:47.460771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:47.460771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 278/566] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:47.460771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d572b7c-f1ee-4c30-aaef-ca3101a7fcf0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:47.602129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1adaf6-0e3e-4f01-a1c3-7bcfe982ea3e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:47.637100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:47.647544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d572b7c-f1ee-4c30-aaef-ca3101a7fcf0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:47.659585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b82092-e99f-4bbc-980a-082351669bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:47.660962 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b82092-e99f-4bbc-980a-082351669bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:47.661460 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b82092-e99f-4bbc-980a-082351669bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:47.661951 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b82092-e99f-4bbc-980a-082351669bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:47.680201 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b82092-e99f-4bbc-980a-082351669bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:47.683055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b82092-e99f-4bbc-980a-082351669bd9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:47.686376 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5d1ee-4a57-493c-9038-c0b2fdbfbfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:47.687250 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5d1ee-4a57-493c-9038-c0b2fdbfbfdb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:47.687536 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5d1ee-4a57-493c-9038-c0b2fdbfbfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:47.687804 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5d1ee-4a57-493c-9038-c0b2fdbfbfdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:47.700133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5d1ee-4a57-493c-9038-c0b2fdbfbfdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:47.705512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-85b82092-e99f-4bbc-980a-082351669bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:47.705512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:47.705512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:47.705512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:47.705512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:47.705512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:47.705512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:47.705512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:47.705512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:47.705512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:47.705512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:47.705512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:47.705512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:47.705512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:47.705512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:47.707203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:47.708912 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:47.708912 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:47.708912 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:47.708912 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-95a5d1ee-4a57-493c-9038-c0b2fdbfbfdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:47.715434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:47.717424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:47.719406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:47.719406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:47.719406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:47.719406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:47.719406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:47.719406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:47.719406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:47.719406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:47.719406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:47.719406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:47.719406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:47.719406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:47.719406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 279/567] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:47.719406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5d1ee-4a57-493c-9038-c0b2fdbfbfdb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:47.721148 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 289/568] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:47.721148 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b82092-e99f-4bbc-980a-082351669bd9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:47.770469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:47.843484 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b82092-e99f-4bbc-980a-082351669bd9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:47.849909 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5d1ee-4a57-493c-9038-c0b2fdbfbfdb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:47.900597 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e311bc6-2438-47e7-9b34-d389494a8521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:47.901632 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e311bc6-2438-47e7-9b34-d389494a8521 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:47.902089 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e311bc6-2438-47e7-9b34-d389494a8521 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:47.902533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e311bc6-2438-47e7-9b34-d389494a8521 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:47.904005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e311bc6-2438-47e7-9b34-d389494a8521 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:47.904655 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e311bc6-2438-47e7-9b34-d389494a8521 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:47.907669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e311bc6-2438-47e7-9b34-d389494a8521 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:47.908545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b5bcd-ae3a-4229-86cb-c70527e8160f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:47.909603 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b5bcd-ae3a-4229-86cb-c70527e8160f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:47.910051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b5bcd-ae3a-4229-86cb-c70527e8160f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:47.910459 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b5bcd-ae3a-4229-86cb-c70527e8160f None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:47.911764 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b5bcd-ae3a-4229-86cb-c70527e8160f None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:47.912287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b5bcd-ae3a-4229-86cb-c70527e8160f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:47.914392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b5bcd-ae3a-4229-86cb-c70527e8160f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:47.928461 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 280/569] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:31:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:47.929833 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b5bcd-ae3a-4229-86cb-c70527e8160f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:47.931785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 290/570] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:31:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:47.933427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e311bc6-2438-47e7-9b34-d389494a8521 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:47.963580 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:48.082472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:48.086222 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e311bc6-2438-47e7-9b34-d389494a8521 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:48.098107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b5bcd-ae3a-4229-86cb-c70527e8160f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:48.132223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fae625-56c9-40e3-b273-438504978e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:48.133075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fae625-56c9-40e3-b273-438504978e4e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:48.133491 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fae625-56c9-40e3-b273-438504978e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:48.133902 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fae625-56c9-40e3-b273-438504978e4e None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:48.134855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fae625-56c9-40e3-b273-438504978e4e None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:48.135296 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fae625-56c9-40e3-b273-438504978e4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:48.137196 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fae625-56c9-40e3-b273-438504978e4e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:48.142088 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f1b52-0bdc-4abf-bab4-646dc6409b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:48.143293 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f1b52-0bdc-4abf-bab4-646dc6409b4e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:48.143804 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f1b52-0bdc-4abf-bab4-646dc6409b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:48.144296 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f1b52-0bdc-4abf-bab4-646dc6409b4e None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:48.145648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f1b52-0bdc-4abf-bab4-646dc6409b4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:48.146203 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f1b52-0bdc-4abf-bab4-646dc6409b4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:48.146927 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 291/571] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:31:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:48.147790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fae625-56c9-40e3-b273-438504978e4e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:48.148881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f1b52-0bdc-4abf-bab4-646dc6409b4e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:48.168900 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 281/572] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:48.169654 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f1b52-0bdc-4abf-bab4-646dc6409b4e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:48.256702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:48.287101 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f1b52-0bdc-4abf-bab4-646dc6409b4e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:48.303196 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fae625-56c9-40e3-b273-438504978e4e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:48.332392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc65ce8-fd39-4fe2-a8f9-4dc8349f60f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:48.333056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc65ce8-fd39-4fe2-a8f9-4dc8349f60f5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:48.333338 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc65ce8-fd39-4fe2-a8f9-4dc8349f60f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:48.333611 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc65ce8-fd39-4fe2-a8f9-4dc8349f60f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:48.334451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc65ce8-fd39-4fe2-a8f9-4dc8349f60f5 None admin] RBAC: Adding query filter params (role.id=0ff0d3dcb5e448c3abc2470461490795, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=cdbfc031f967416e9a2c94bce3d28f66) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:48.334799 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc65ce8-fd39-4fe2-a8f9-4dc8349f60f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:48.336249 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc65ce8-fd39-4fe2-a8f9-4dc8349f60f5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:48.342959 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 282/573] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:31:48 2022] GET /identity/v3/role_assignments?user.id=cdbfc031f967416e9a2c94bce3d28f66&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=0ff0d3dcb5e448c3abc2470461490795 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:48.344081 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7dff3-0011-4fc1-9bfa-5af56780bc1a None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:48.344364 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7dff3-0011-4fc1-9bfa-5af56780bc1a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:48.344639 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7dff3-0011-4fc1-9bfa-5af56780bc1a None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:48.345916 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 283/574] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:48.346727 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7dff3-0011-4fc1-9bfa-5af56780bc1a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:48.365034 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3302a-83b2-4825-a22d-58c66ec1a406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:48.366045 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3302a-83b2-4825-a22d-58c66ec1a406 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:48.366457 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3302a-83b2-4825-a22d-58c66ec1a406 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:48.366910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3302a-83b2-4825-a22d-58c66ec1a406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:48.387990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3302a-83b2-4825-a22d-58c66ec1a406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:48.389932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3302a-83b2-4825-a22d-58c66ec1a406 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:48.413093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-06c3302a-83b2-4825-a22d-58c66ec1a406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:48.413093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:48.413093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:48.413093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:48.413093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:48.413093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:48.413093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:48.413093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:48.413093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:48.413093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:48.413093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:48.413093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:48.413093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:48.413093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:48.413093 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:48.415549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:48.417268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:48.417268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:48.417268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:48.417268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:48.417268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 292/575] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:48.417268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3302a-83b2-4825-a22d-58c66ec1a406 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:48.451083 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:48.544785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7dff3-0011-4fc1-9bfa-5af56780bc1a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:48.575033 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3302a-83b2-4825-a22d-58c66ec1a406 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:48.596142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc62ad6-4337-4524-9b18-2764e716a4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:48.597259 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc62ad6-4337-4524-9b18-2764e716a4bd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:48.597643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc62ad6-4337-4524-9b18-2764e716a4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:48.597984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc62ad6-4337-4524-9b18-2764e716a4bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:48.612515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc62ad6-4337-4524-9b18-2764e716a4bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:48.614447 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc62ad6-4337-4524-9b18-2764e716a4bd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:48.616942 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:48.619011 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f93f1-c390-4131-ac5b-9f815ca03584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:48.619846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f93f1-c390-4131-ac5b-9f815ca03584 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:48.620127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f93f1-c390-4131-ac5b-9f815ca03584 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:48.620759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f93f1-c390-4131-ac5b-9f815ca03584 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:48.630102 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f93f1-c390-4131-ac5b-9f815ca03584 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:48.631625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f93f1-c390-4131-ac5b-9f815ca03584 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:48.641803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-2cc62ad6-4337-4524-9b18-2764e716a4bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:48.641803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:48.641803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:48.641803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:48.641803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:48.641803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:48.641803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:48.641803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:48.641803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:48.641803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:48.641803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:48.641803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:48.641803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:48.641803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:48.641803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:48.644119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:48.646482 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:48.646482 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:48.646482 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:48.646482 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:48.646482 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 284/576] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:48.647883 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afc04f-71cd-4cf7-b6ae-f4fb5ee175cb None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:48.647883 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afc04f-71cd-4cf7-b6ae-f4fb5ee175cb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:48.647883 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afc04f-71cd-4cf7-b6ae-f4fb5ee175cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:48.654103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2f2f93f1-c390-4131-ac5b-9f815ca03584 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:48.654103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:48.654103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:48.654103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:48.654103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:48.654103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:48.654103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:48.654103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:48.654103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:48.654103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:48.654103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:48.654103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:48.654103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:31:48.654103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:31:48.654103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:48.657592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:48.660381 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:31:48.660381 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:31:48.660381 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:31:48.660381 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:31:48.660381 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:31:48.660381 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:31:48.660381 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:48.660381 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:48.660381 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 293/577] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:48.660381 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f93f1-c390-4131-ac5b-9f815ca03584 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:48.674816 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b8afc04f-71cd-4cf7-b6ae-f4fb5ee175cb None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:48.676098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b8afc04f-71cd-4cf7-b6ae-f4fb5ee175cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:48.764082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:48.770571 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 285/578] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:48.770571 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afc04f-71cd-4cf7-b6ae-f4fb5ee175cb None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:48.813481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f93f1-c390-4131-ac5b-9f815ca03584 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:48.865875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f3b03-c4ed-49bd-a7e3-4f38d32f7e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:48.866753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f3b03-c4ed-49bd-a7e3-4f38d32f7e00 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:48.867195 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f3b03-c4ed-49bd-a7e3-4f38d32f7e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:48.867567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f3b03-c4ed-49bd-a7e3-4f38d32f7e00 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:48.868952 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f3b03-c4ed-49bd-a7e3-4f38d32f7e00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:48.869359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f3b03-c4ed-49bd-a7e3-4f38d32f7e00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:48.871233 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f3b03-c4ed-49bd-a7e3-4f38d32f7e00 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:48.884604 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 294/579] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:48.885478 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f3b03-c4ed-49bd-a7e3-4f38d32f7e00 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:48.925950 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afc04f-71cd-4cf7-b6ae-f4fb5ee175cb None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:48.975995 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:48.996332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee398bd-f326-4ae1-a3bf-ed578530f7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:48.997052 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee398bd-f326-4ae1-a3bf-ed578530f7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:48.997903 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee398bd-f326-4ae1-a3bf-ed578530f7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:48.998189 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee398bd-f326-4ae1-a3bf-ed578530f7c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:48.998979 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee398bd-f326-4ae1-a3bf-ed578530f7c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:48.999290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee398bd-f326-4ae1-a3bf-ed578530f7c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:49.000875 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee398bd-f326-4ae1-a3bf-ed578530f7c9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:49.016508 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f3b03-c4ed-49bd-a7e3-4f38d32f7e00 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:49.027373 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 286/580] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:49.028955 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee398bd-f326-4ae1-a3bf-ed578530f7c9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:49.068722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e2e8a-dd3f-45ca-8dbd-8bafc10c982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:49.069874 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2e8a-dd3f-45ca-8dbd-8bafc10c982e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:49.070391 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2e8a-dd3f-45ca-8dbd-8bafc10c982e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:49.071465 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2e8a-dd3f-45ca-8dbd-8bafc10c982e None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:49.073975 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e2e8a-dd3f-45ca-8dbd-8bafc10c982e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:49.074594 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e2e8a-dd3f-45ca-8dbd-8bafc10c982e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:49.077600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e2e8a-dd3f-45ca-8dbd-8bafc10c982e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:49.080922 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:49.108745 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 295/581] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:31:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:49.108745 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e2e8a-dd3f-45ca-8dbd-8bafc10c982e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:49.232432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee398bd-f326-4ae1-a3bf-ed578530f7c9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:49.256844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e2e8a-dd3f-45ca-8dbd-8bafc10c982e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:49.304017 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54239d-5472-4a7c-9a45-2b3693ad4fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:49.305975 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54239d-5472-4a7c-9a45-2b3693ad4fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:49.306527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54239d-5472-4a7c-9a45-2b3693ad4fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:49.306683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27945e6-439f-4d82-a6fd-96e8ba0dfe28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:49.307025 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54239d-5472-4a7c-9a45-2b3693ad4fb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:49.307412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27945e6-439f-4d82-a6fd-96e8ba0dfe28 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:49.307795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27945e6-439f-4d82-a6fd-96e8ba0dfe28 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:49.308129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27945e6-439f-4d82-a6fd-96e8ba0dfe28 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:49.317275 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27945e6-439f-4d82-a6fd-96e8ba0dfe28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:49.318789 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27945e6-439f-4d82-a6fd-96e8ba0dfe28 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:49.328009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54239d-5472-4a7c-9a45-2b3693ad4fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-fd54239d-5472-4a7c-9a45-2b3693ad4fb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:49.343891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:49.344992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:49.345814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:49.345814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:49.345814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:49.345814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:49.345814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:49.345814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:49.345814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:49.345814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:49.345814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:49.345814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:49.345814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:49.345814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f27945e6-439f-4d82-a6fd-96e8ba0dfe28 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:31:49.346996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:49.347885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:49.355031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:49.355031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:49.355031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:31:49.355031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:31:49.355031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:31:49.355031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:31:49.355031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:31:49.355031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:31:49.355031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 09:31:49.355031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:49.355031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 296/582] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:49.355031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27945e6-439f-4d82-a6fd-96e8ba0dfe28 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:49.356561 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 287/583] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:49.356561 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54239d-5472-4a7c-9a45-2b3693ad4fb3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:49.417307 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:49.462346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:49.524147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54239d-5472-4a7c-9a45-2b3693ad4fb3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:49.542640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27945e6-439f-4d82-a6fd-96e8ba0dfe28 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:49.594200 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad16149-3e87-4fba-bcf6-68edec0e781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:49.595243 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad16149-3e87-4fba-bcf6-68edec0e781d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:49.595660 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad16149-3e87-4fba-bcf6-68edec0e781d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:49.595927 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ff717-eabc-4ec6-842d-5b857ac44bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:49.596204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad16149-3e87-4fba-bcf6-68edec0e781d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:49.597416 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ff717-eabc-4ec6-842d-5b857ac44bce None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:49.597863 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ff717-eabc-4ec6-842d-5b857ac44bce None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:49.598346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ff717-eabc-4ec6-842d-5b857ac44bce None admin] PATH_INFO: `/v3/projects/b978d75b349941f5bedbe56544f41ada/users/26dbaf7292444c8f9a6d45bfaf96763f/roles/0ff0d3dcb5e448c3abc2470461490795` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:49.607608 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad16149-3e87-4fba-bcf6-68edec0e781d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:49.609130 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad16149-3e87-4fba-bcf6-68edec0e781d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5ad16149-3e87-4fba-bcf6-68edec0e781d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:31:49.627401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:49.637862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:49.640139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:49.640139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:49.640139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:31:49.640139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:31:49.640139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:31:49.640139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:31:49.640139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:31:49.640139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:31:49.640139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 09:31:49.640139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:49.641613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ff717-eabc-4ec6-842d-5b857ac44bce None admin] RBAC: Authorizing `identity:create_grant(project_id=b978d75b349941f5bedbe56544f41ada, user_id=26dbaf7292444c8f9a6d45bfaf96763f, role_id=0ff0d3dcb5e448c3abc2470461490795)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:49.641760 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 297/584] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:49.641894 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ff717-eabc-4ec6-842d-5b857ac44bce None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:49.642625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad16149-3e87-4fba-bcf6-68edec0e781d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:49.675124 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 288/585] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:31:49 2022] PUT /identity/v3/projects/b978d75b349941f5bedbe56544f41ada/users/26dbaf7292444c8f9a6d45bfaf96763f/roles/0ff0d3dcb5e448c3abc2470461490795 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:31:49.675124 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ff717-eabc-4ec6-842d-5b857ac44bce None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:49.830055 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:49.831919 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad16149-3e87-4fba-bcf6-68edec0e781d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:49.839561 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ff717-eabc-4ec6-842d-5b857ac44bce None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:49.855058 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:49.891352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f54bd-ca78-4cd2-a37e-cf4f2b058d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:49.892072 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f54bd-ca78-4cd2-a37e-cf4f2b058d6c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:49.892365 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f54bd-ca78-4cd2-a37e-cf4f2b058d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:49.892650 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f54bd-ca78-4cd2-a37e-cf4f2b058d6c None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:49.893449 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f54bd-ca78-4cd2-a37e-cf4f2b058d6c None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:49.893795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f54bd-ca78-4cd2-a37e-cf4f2b058d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:49.895502 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f54bd-ca78-4cd2-a37e-cf4f2b058d6c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:49.896101 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dfa99-4124-4ef3-a269-8b8f0b3c2e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:49.897819 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dfa99-4124-4ef3-a269-8b8f0b3c2e02 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:49.899295 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dfa99-4124-4ef3-a269-8b8f0b3c2e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:49.900199 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dfa99-4124-4ef3-a269-8b8f0b3c2e02 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:49.902167 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dfa99-4124-4ef3-a269-8b8f0b3c2e02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:49.903341 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dfa99-4124-4ef3-a269-8b8f0b3c2e02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:49.906484 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dfa99-4124-4ef3-a269-8b8f0b3c2e02 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:49.910766 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 289/586] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:31:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:49.915223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f54bd-ca78-4cd2-a37e-cf4f2b058d6c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:49.948532 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 298/587] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Jun 15 09:31:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:49.950970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dfa99-4124-4ef3-a269-8b8f0b3c2e02 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:50.114813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f54bd-ca78-4cd2-a37e-cf4f2b058d6c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:50.151803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dfa99-4124-4ef3-a269-8b8f0b3c2e02 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:50.185396 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250277b-e430-4851-ad52-5b681c6bb212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:50.186179 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250277b-e430-4851-ad52-5b681c6bb212 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:50.186671 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250277b-e430-4851-ad52-5b681c6bb212 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:50.187099 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250277b-e430-4851-ad52-5b681c6bb212 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:50.188525 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250277b-e430-4851-ad52-5b681c6bb212 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:50.189023 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250277b-e430-4851-ad52-5b681c6bb212 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:50.191512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250277b-e430-4851-ad52-5b681c6bb212 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:50.221531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade8580-b153-4815-8f75-e9c26330286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:50.223237 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8580-b153-4815-8f75-e9c26330286b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:50.223861 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8580-b153-4815-8f75-e9c26330286b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:50.224536 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8580-b153-4815-8f75-e9c26330286b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:50.234030 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 290/588] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Jun 15 09:31:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:50.235598 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250277b-e430-4851-ad52-5b681c6bb212 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:50.245277 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade8580-b153-4815-8f75-e9c26330286b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:50.248344 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade8580-b153-4815-8f75-e9c26330286b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:50.267824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:50.289472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5ade8580-b153-4815-8f75-e9c26330286b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:50.289472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:50.289472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:50.289472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:50.289472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:50.289472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:50.289472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:50.289472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:50.289472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:50.289472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:50.289472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:50.289472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:50.289472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:50.289472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:50.289472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:50.290419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:50.291340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:50.291340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:50.291340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:50.291340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:50.292543 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 299/589] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:50.294415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade8580-b153-4815-8f75-e9c26330286b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:50.340885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:50.425546 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250277b-e430-4851-ad52-5b681c6bb212 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:50.466672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ae393-0be7-4d1c-b1ff-4b37a638e42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:50.467611 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ae393-0be7-4d1c-b1ff-4b37a638e42c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:50.467901 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ae393-0be7-4d1c-b1ff-4b37a638e42c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:50.468184 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ae393-0be7-4d1c-b1ff-4b37a638e42c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:50.469887 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade8580-b153-4815-8f75-e9c26330286b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:50.480204 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ae393-0be7-4d1c-b1ff-4b37a638e42c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:50.481828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ae393-0be7-4d1c-b1ff-4b37a638e42c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:50.502613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-964ae393-0be7-4d1c-b1ff-4b37a638e42c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:50.502613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:50.502613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:50.502613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:50.502613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:50.502613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:50.502613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:50.502613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:50.502613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:50.502613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:50.502613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:50.502613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:50.502613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:50.502613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:50.502613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:50.504759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:50.506200 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:50.506200 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:50.506200 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:50.506200 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:50.509250 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 291/590] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:50.510234 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ae393-0be7-4d1c-b1ff-4b37a638e42c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:50.511059 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caa4be-c2a4-42c4-b657-f98584910639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:50.511981 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa4be-c2a4-42c4-b657-f98584910639 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:50.512365 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa4be-c2a4-42c4-b657-f98584910639 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:50.512736 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4caa4be-c2a4-42c4-b657-f98584910639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:50.528355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4caa4be-c2a4-42c4-b657-f98584910639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:50.530056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4caa4be-c2a4-42c4-b657-f98584910639 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:50.552030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e4caa4be-c2a4-42c4-b657-f98584910639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:50.552030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:50.552030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:50.552030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:50.552030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:50.552030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:50.552030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:50.552030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:50.552030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:50.552030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:50.552030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:50.552030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:50.552030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:50.552030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:50.552030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:50.553170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:50.554168 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:50.554168 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:50.554168 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:50.554168 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:50.560410 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 300/591] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:50.560410 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caa4be-c2a4-42c4-b657-f98584910639 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:50.606745 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:50.648602 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ae393-0be7-4d1c-b1ff-4b37a638e42c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:50.651971 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:50.683549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4caa4be-c2a4-42c4-b657-f98584910639 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:50.696465 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b9ef6-a0f9-45d1-8f8b-1abff4049db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:50.697607 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9ef6-a0f9-45d1-8f8b-1abff4049db1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:50.698082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9ef6-a0f9-45d1-8f8b-1abff4049db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:50.698572 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9ef6-a0f9-45d1-8f8b-1abff4049db1 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:50.699535 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b9ef6-a0f9-45d1-8f8b-1abff4049db1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:50.700045 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b9ef6-a0f9-45d1-8f8b-1abff4049db1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:50.701896 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b9ef6-a0f9-45d1-8f8b-1abff4049db1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:50.716313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 292/592] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:50.717580 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b9ef6-a0f9-45d1-8f8b-1abff4049db1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:50.723962 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf2a5d-0050-4bc6-99de-651c5787ea8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:50.724690 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf2a5d-0050-4bc6-99de-651c5787ea8f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:50.724975 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf2a5d-0050-4bc6-99de-651c5787ea8f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:50.725248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf2a5d-0050-4bc6-99de-651c5787ea8f None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:50.725975 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf2a5d-0050-4bc6-99de-651c5787ea8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:50.726278 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf2a5d-0050-4bc6-99de-651c5787ea8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:50.728235 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf2a5d-0050-4bc6-99de-651c5787ea8f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:50.741537 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 301/593] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:50.743174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf2a5d-0050-4bc6-99de-651c5787ea8f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:50.838323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b9ef6-a0f9-45d1-8f8b-1abff4049db1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:50.877797 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf2a5d-0050-4bc6-99de-651c5787ea8f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:50.878751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:50.889188 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67ed73-707b-4b90-9228-36b2a5b42de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:50.889866 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67ed73-707b-4b90-9228-36b2a5b42de4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:50.890151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67ed73-707b-4b90-9228-36b2a5b42de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:50.890700 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67ed73-707b-4b90-9228-36b2a5b42de4 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:50.891447 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67ed73-707b-4b90-9228-36b2a5b42de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:50.891756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67ed73-707b-4b90-9228-36b2a5b42de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:50.893132 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67ed73-707b-4b90-9228-36b2a5b42de4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:50.906236 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 293/594] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:50.907424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f31e0f-4a95-445d-944f-e804ee9cb419 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:50.907802 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f31e0f-4a95-445d-944f-e804ee9cb419 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:50.908013 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f31e0f-4a95-445d-944f-e804ee9cb419 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:50.913364 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 294/595] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:50.913364 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f31e0f-4a95-445d-944f-e804ee9cb419 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:50.934111 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda304d8-2dfa-46d7-8100-f6de6f969a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:50.934782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda304d8-2dfa-46d7-8100-f6de6f969a25 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:50.935079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda304d8-2dfa-46d7-8100-f6de6f969a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:50.935478 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda304d8-2dfa-46d7-8100-f6de6f969a25 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:50.939022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:50.946834 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda304d8-2dfa-46d7-8100-f6de6f969a25 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:50.949851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda304d8-2dfa-46d7-8100-f6de6f969a25 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-cda304d8-2dfa-46d7-8100-f6de6f969a25 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:31:50.966749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:50.967825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:50.973869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:50.973869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:50.973869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:31:50.973869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:31:50.973869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:31:50.973869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:31:50.973869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:31:50.973869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:31:50.973869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 09:31:50.973869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:50.973869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 302/596] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:50.973869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda304d8-2dfa-46d7-8100-f6de6f969a25 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:51.048073 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f31e0f-4a95-445d-944f-e804ee9cb419 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:51.102791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b82c3e-e059-479a-b053-e16a59ef3d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:51.104151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b82c3e-e059-479a-b053-e16a59ef3d44 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:51.104667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b82c3e-e059-479a-b053-e16a59ef3d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:51.105180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b82c3e-e059-479a-b053-e16a59ef3d44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:51.114083 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda304d8-2dfa-46d7-8100-f6de6f969a25 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:51.116386 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b82c3e-e059-479a-b053-e16a59ef3d44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:51.118432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b82c3e-e059-479a-b053-e16a59ef3d44 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:51.133176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a4b82c3e-e059-479a-b053-e16a59ef3d44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:51.133176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:51.133176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:51.133176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:51.133176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:51.133176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:51.133176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:51.133176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:51.133176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:51.133176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:51.133176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:51.133176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:51.133176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:31:51.133176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:31:51.133176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:51.136750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:51.140707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:31:51.140707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:31:51.140707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:31:51.140707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:31:51.140707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:31:51.140707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:31:51.140707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:51.140707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:51.140707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 295/597] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:51.140707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2cad7-ddb1-44ff-b985-4ee44c25cea8 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:51.142159 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2cad7-ddb1-44ff-b985-4ee44c25cea8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:51.142159 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2cad7-ddb1-44ff-b985-4ee44c25cea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:51.165861 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a12d3b-29fc-4927-9ad0-7cda417ea251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:51.166708 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a12d3b-29fc-4927-9ad0-7cda417ea251 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:51.166998 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a12d3b-29fc-4927-9ad0-7cda417ea251 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:51.167309 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a12d3b-29fc-4927-9ad0-7cda417ea251 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:51.171046 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2bb2cad7-ddb1-44ff-b985-4ee44c25cea8 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:51.173251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2bb2cad7-ddb1-44ff-b985-4ee44c25cea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:51.174879 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a12d3b-29fc-4927-9ad0-7cda417ea251 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:51.176353 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a12d3b-29fc-4927-9ad0-7cda417ea251 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:51.192198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-09a12d3b-29fc-4927-9ad0-7cda417ea251 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:51.192198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:51.192198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:51.192198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:51.192198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:51.192198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:51.192198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:51.192198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:51.192198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:51.192198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:51.192198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:51.192198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:51.192198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:31:51.192198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:31:51.192198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:51.193155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:51.194231 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:31:51.194231 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:31:51.194231 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:31:51.194231 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:31:51.194231 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:31:51.194231 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:31:51.194231 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:51.194231 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:51.198627 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 303/598] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:51.198966 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a12d3b-29fc-4927-9ad0-7cda417ea251 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:51.243592 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:51.290551 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 296/599] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:51.290551 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2cad7-ddb1-44ff-b985-4ee44c25cea8 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:51.308308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:51.382016 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a12d3b-29fc-4927-9ad0-7cda417ea251 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:51.435894 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2c2ca-8a85-4d08-b0a7-3d4dcedfa598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:51.436686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2c2ca-8a85-4d08-b0a7-3d4dcedfa598 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:51.437001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2c2ca-8a85-4d08-b0a7-3d4dcedfa598 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:51.437280 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2c2ca-8a85-4d08-b0a7-3d4dcedfa598 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:51.438437 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2c2ca-8a85-4d08-b0a7-3d4dcedfa598 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:51.438437 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2c2ca-8a85-4d08-b0a7-3d4dcedfa598 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:51.439990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2c2ca-8a85-4d08-b0a7-3d4dcedfa598 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:51.447114 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2cad7-ddb1-44ff-b985-4ee44c25cea8 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:51.467308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 304/600] 10.222.0.45 () {56 vars in 1139 bytes} [Wed Jun 15 09:31:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:51.468218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2c2ca-8a85-4d08-b0a7-3d4dcedfa598 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:51.495223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664359dd-179e-46a1-942d-3d90f9c11774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:51.496374 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664359dd-179e-46a1-942d-3d90f9c11774 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:51.496866 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664359dd-179e-46a1-942d-3d90f9c11774 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:51.497354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664359dd-179e-46a1-942d-3d90f9c11774 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:51.498842 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664359dd-179e-46a1-942d-3d90f9c11774 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:51.499218 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664359dd-179e-46a1-942d-3d90f9c11774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:51.501153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664359dd-179e-46a1-942d-3d90f9c11774 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:51.527967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 297/601] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:31:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:51.528979 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664359dd-179e-46a1-942d-3d90f9c11774 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:51.575369 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:51.630003 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2c2ca-8a85-4d08-b0a7-3d4dcedfa598 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:51.647268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:51.672881 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dcf22-ae27-47ad-9696-748ca82f7eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:51.674283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dcf22-ae27-47ad-9696-748ca82f7eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:51.674602 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dcf22-ae27-47ad-9696-748ca82f7eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:51.675269 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dcf22-ae27-47ad-9696-748ca82f7eb4 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:51.675691 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dcf22-ae27-47ad-9696-748ca82f7eb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:51.676006 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dcf22-ae27-47ad-9696-748ca82f7eb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:51.677476 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dcf22-ae27-47ad-9696-748ca82f7eb4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:51.678580 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664359dd-179e-46a1-942d-3d90f9c11774 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:51.690435 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 305/602] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:31:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:51.691329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dcf22-ae27-47ad-9696-748ca82f7eb4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:51.729290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b91c5-346d-4756-8412-21393471495e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:51.730004 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b91c5-346d-4756-8412-21393471495e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:51.730286 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b91c5-346d-4756-8412-21393471495e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:51.730605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b91c5-346d-4756-8412-21393471495e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:51.743292 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b91c5-346d-4756-8412-21393471495e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a46b91c5-346d-4756-8412-21393471495e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:51.751223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:51.753223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:51.754872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:51.754872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:51.754872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:51.754872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:51.754872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:51.754872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:51.754872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:51.754872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:51.754872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:51.754872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:51.754872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:51.754872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:51.754872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 298/603] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:51.754872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b91c5-346d-4756-8412-21393471495e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:51.856921 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dcf22-ae27-47ad-9696-748ca82f7eb4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:51.890873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:51.900202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b91c5-346d-4756-8412-21393471495e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:51.902658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd25acc-f4fc-4ab4-bd0b-124cc494c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:51.904361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd25acc-f4fc-4ab4-bd0b-124cc494c0fe None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:51.904361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd25acc-f4fc-4ab4-bd0b-124cc494c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:51.904361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd25acc-f4fc-4ab4-bd0b-124cc494c0fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:51.917374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd25acc-f4fc-4ab4-bd0b-124cc494c0fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:51.919264 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd25acc-f4fc-4ab4-bd0b-124cc494c0fe None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:51.939566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6bd25acc-f4fc-4ab4-bd0b-124cc494c0fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:51.939566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:51.939566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:51.939566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:51.939566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:51.939566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:51.939566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:51.939566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:51.939566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:51.939566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:51.939566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:51.939566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:51.939566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:51.939566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:51.939566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:51.940949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:51.943505 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:51.943505 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:51.943505 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:51.943505 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:51.943505 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 306/604] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:51.943505 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd25acc-f4fc-4ab4-bd0b-124cc494c0fe None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:51.956642 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb7350-b77a-4d34-b3db-fbe464279b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:51.957570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb7350-b77a-4d34-b3db-fbe464279b96 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:51.958040 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb7350-b77a-4d34-b3db-fbe464279b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:51.958186 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb7350-b77a-4d34-b3db-fbe464279b96 None admin] PATH_INFO: `/v3/projects/b978d75b349941f5bedbe56544f41ada/users/e6608bed12f746b89527a80b05459e5e/roles/0ff0d3dcb5e448c3abc2470461490795` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:51.977296 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb7350-b77a-4d34-b3db-fbe464279b96 None admin] RBAC: Authorizing `identity:create_grant(project_id=b978d75b349941f5bedbe56544f41ada, user_id=e6608bed12f746b89527a80b05459e5e, role_id=0ff0d3dcb5e448c3abc2470461490795)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:51.978958 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb7350-b77a-4d34-b3db-fbe464279b96 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:51.995601 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:52.002550 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 299/605] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:31:51 2022] PUT /identity/v3/projects/b978d75b349941f5bedbe56544f41ada/users/e6608bed12f746b89527a80b05459e5e/roles/0ff0d3dcb5e448c3abc2470461490795 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:31:52.002550 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb7350-b77a-4d34-b3db-fbe464279b96 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:52.122103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd25acc-f4fc-4ab4-bd0b-124cc494c0fe None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:52.145774 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb7350-b77a-4d34-b3db-fbe464279b96 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:52.171575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9b418-948a-41be-9182-d14f10c427c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:52.172879 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9b418-948a-41be-9182-d14f10c427c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:52.173165 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9b418-948a-41be-9182-d14f10c427c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:52.174289 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9b418-948a-41be-9182-d14f10c427c9 None admin] PATH_INFO: `/v3/projects/b978d75b349941f5bedbe56544f41ada/users/303c1175b5d24b0d8a929c7905a4c17c/roles/0ff0d3dcb5e448c3abc2470461490795` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:52.193016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036eedb-3b08-4324-9436-526f2cf29c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:52.193737 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036eedb-3b08-4324-9436-526f2cf29c5c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:52.194026 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036eedb-3b08-4324-9436-526f2cf29c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:52.194310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036eedb-3b08-4324-9436-526f2cf29c5c None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:52.195111 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036eedb-3b08-4324-9436-526f2cf29c5c None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:52.195502 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036eedb-3b08-4324-9436-526f2cf29c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:52.197404 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036eedb-3b08-4324-9436-526f2cf29c5c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:52.200717 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9b418-948a-41be-9182-d14f10c427c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b978d75b349941f5bedbe56544f41ada, user_id=303c1175b5d24b0d8a929c7905a4c17c, role_id=0ff0d3dcb5e448c3abc2470461490795)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:52.203326 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9b418-948a-41be-9182-d14f10c427c9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:52.209383 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 300/606] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:31:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:52.210285 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036eedb-3b08-4324-9436-526f2cf29c5c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:52.227849 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:52.229448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 307/607] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:31:51 2022] PUT /identity/v3/projects/b978d75b349941f5bedbe56544f41ada/users/303c1175b5d24b0d8a929c7905a4c17c/roles/0ff0d3dcb5e448c3abc2470461490795 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:31:52.231235 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f251e-e9d6-43f2-b461-caf606a64acd None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:52.231772 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f251e-e9d6-43f2-b461-caf606a64acd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:52.232200 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f251e-e9d6-43f2-b461-caf606a64acd None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:52.238178 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 308/608] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:52.239273 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f251e-e9d6-43f2-b461-caf606a64acd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:52.350801 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:52.366781 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036eedb-3b08-4324-9436-526f2cf29c5c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:52.385478 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f251e-e9d6-43f2-b461-caf606a64acd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:52.413856 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84586f11-6eda-4b76-9511-45879840b9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:52.415178 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84586f11-6eda-4b76-9511-45879840b9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:52.415458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84586f11-6eda-4b76-9511-45879840b9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:52.415917 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84586f11-6eda-4b76-9511-45879840b9f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:52.416669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84586f11-6eda-4b76-9511-45879840b9f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:52.416983 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84586f11-6eda-4b76-9511-45879840b9f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:52.419181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84586f11-6eda-4b76-9511-45879840b9f9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:52.431364 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9eec1-d8c3-4c4d-9875-90b94deae233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:52.432207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9eec1-d8c3-4c4d-9875-90b94deae233 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:52.432465 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9eec1-d8c3-4c4d-9875-90b94deae233 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:52.432738 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9eec1-d8c3-4c4d-9875-90b94deae233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:52.437092 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 301/609] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:52.438436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fa846-660c-46c6-ae8b-12c73d328db3 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:52.438779 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fa846-660c-46c6-ae8b-12c73d328db3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:52.440363 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fa846-660c-46c6-ae8b-12c73d328db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:52.447552 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9eec1-d8c3-4c4d-9875-90b94deae233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:52.449076 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9eec1-d8c3-4c4d-9875-90b94deae233 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:52.459329 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-295fa846-660c-46c6-ae8b-12c73d328db3 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:52.460859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-295fa846-660c-46c6-ae8b-12c73d328db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:52.473497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-09a9eec1-d8c3-4c4d-9875-90b94deae233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:52.473497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:52.473497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:52.473497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:52.473497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:52.473497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:52.473497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:52.473497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:52.473497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:52.473497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:52.473497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:52.473497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:52.473497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:52.473497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:52.473497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:52.474577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:52.475629 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:52.475629 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:52.475629 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:52.475629 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:52.475629 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 309/610] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:52.476248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9eec1-d8c3-4c4d-9875-90b94deae233 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:52.569818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 302/611] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:52.570531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:52.572445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fa846-660c-46c6-ae8b-12c73d328db3 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:52.604211 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9eec1-d8c3-4c4d-9875-90b94deae233 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:52.642244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:52.655190 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8fa05-9a0a-4b32-8911-d295687c82c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:52.656012 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8fa05-9a0a-4b32-8911-d295687c82c8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:52.656727 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8fa05-9a0a-4b32-8911-d295687c82c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:52.657015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8fa05-9a0a-4b32-8911-d295687c82c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:52.665311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8fa05-9a0a-4b32-8911-d295687c82c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:52.667734 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8fa05-9a0a-4b32-8911-d295687c82c8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:52.683225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a1d8fa05-9a0a-4b32-8911-d295687c82c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:52.683225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:52.683225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:52.683225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:52.683225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:52.683225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:52.683225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:52.683225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:52.683225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:52.683225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:52.683225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:52.683225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:52.683225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:31:52.683225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:31:52.683225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:52.684617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:52.685858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:31:52.685858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:31:52.685858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:31:52.685858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:31:52.685858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:31:52.685858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:31:52.685858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:52.685858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:52.685858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 310/612] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:52.685858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8fa05-9a0a-4b32-8911-d295687c82c8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:52.702787 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fa846-660c-46c6-ae8b-12c73d328db3 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:52.742268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b519-d5a1-4b99-b2c8-35876789c4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:52.743047 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b519-d5a1-4b99-b2c8-35876789c4ba None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:52.743332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b519-d5a1-4b99-b2c8-35876789c4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:52.743641 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b519-d5a1-4b99-b2c8-35876789c4ba None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:52.744416 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2b519-d5a1-4b99-b2c8-35876789c4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:52.744766 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2b519-d5a1-4b99-b2c8-35876789c4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:52.746179 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2b519-d5a1-4b99-b2c8-35876789c4ba None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:52.759648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 303/613] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:52.760566 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b519-d5a1-4b99-b2c8-35876789c4ba None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:52.835348 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:52.837376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8fa05-9a0a-4b32-8911-d295687c82c8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:52.883758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445992-68dd-4ffc-8bff-42f9caa25075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:52.884792 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445992-68dd-4ffc-8bff-42f9caa25075 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:52.885075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445992-68dd-4ffc-8bff-42f9caa25075 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:52.885355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445992-68dd-4ffc-8bff-42f9caa25075 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:52.901226 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d445992-68dd-4ffc-8bff-42f9caa25075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:52.901992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b519-d5a1-4b99-b2c8-35876789c4ba None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1d445992-68dd-4ffc-8bff-42f9caa25075 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:52.913826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:52.916669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:52.918811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:52.918811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:52.918811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:52.918811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:52.918811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:52.918811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:52.918811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:52.918811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:52.918811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:52.918811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:52.918811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:52.918811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:52.918811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 311/614] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:52.918811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445992-68dd-4ffc-8bff-42f9caa25075 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:52.949914 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d5a13-d839-48f9-a76c-1c62a3cea94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:52.950624 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d5a13-d839-48f9-a76c-1c62a3cea94a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:52.950915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d5a13-d839-48f9-a76c-1c62a3cea94a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:52.951196 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d5a13-d839-48f9-a76c-1c62a3cea94a None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:52.952272 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d5a13-d839-48f9-a76c-1c62a3cea94a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:52.952590 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d5a13-d839-48f9-a76c-1c62a3cea94a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:52.954487 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d5a13-d839-48f9-a76c-1c62a3cea94a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:52.970390 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 304/615] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:31:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:52.971299 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d5a13-d839-48f9-a76c-1c62a3cea94a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:53.019651 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:53.105727 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d5a13-d839-48f9-a76c-1c62a3cea94a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:53.117826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445992-68dd-4ffc-8bff-42f9caa25075 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:53.142121 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:53.167151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e08b0b-912f-4b40-a762-c665f185763a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:53.168409 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e08b0b-912f-4b40-a762-c665f185763a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:53.168891 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369eed1-8102-458d-bebd-c61b9d26e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:53.169025 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e08b0b-912f-4b40-a762-c665f185763a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:53.169423 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e08b0b-912f-4b40-a762-c665f185763a None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:53.170142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369eed1-8102-458d-bebd-c61b9d26e8ce None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:53.170597 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369eed1-8102-458d-bebd-c61b9d26e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:53.170972 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e08b0b-912f-4b40-a762-c665f185763a None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:53.171182 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369eed1-8102-458d-bebd-c61b9d26e8ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:53.171541 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e08b0b-912f-4b40-a762-c665f185763a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:53.174153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e08b0b-912f-4b40-a762-c665f185763a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:53.183756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369eed1-8102-458d-bebd-c61b9d26e8ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:53.185511 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369eed1-8102-458d-bebd-c61b9d26e8ce None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:53.192561 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 305/616] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:31:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:53.194153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e08b0b-912f-4b40-a762-c665f185763a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c369eed1-8102-458d-bebd-c61b9d26e8ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:31:53.204876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:53.206109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:53.207204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:53.207204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:53.207204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:31:53.207204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:31:53.207204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:31:53.207204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:31:53.207204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:31:53.207204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:31:53.207204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 09:31:53.207204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:53.215169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 312/617] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:31:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:53.218743 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369eed1-8102-458d-bebd-c61b9d26e8ce None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:53.338742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369eed1-8102-458d-bebd-c61b9d26e8ce None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:53.350030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:53.380893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470955d7-20e8-4c5c-bfab-4ebc7db2b093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:53.382086 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470955d7-20e8-4c5c-bfab-4ebc7db2b093 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:53.382660 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470955d7-20e8-4c5c-bfab-4ebc7db2b093 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:53.383698 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470955d7-20e8-4c5c-bfab-4ebc7db2b093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:53.388984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e08b0b-912f-4b40-a762-c665f185763a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:53.397241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470955d7-20e8-4c5c-bfab-4ebc7db2b093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:53.399098 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470955d7-20e8-4c5c-bfab-4ebc7db2b093 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:53.419010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-470955d7-20e8-4c5c-bfab-4ebc7db2b093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:53.419010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:53.419010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:53.419010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:53.419010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:53.419010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:53.419010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:53.419010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:53.419010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:53.419010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:53.419010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:53.419010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:53.419010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:53.419010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:53.419010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:53.420224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:53.421121 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:53.421121 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:53.421121 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:53.421121 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:53.423523 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 313/618] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:53.424777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470955d7-20e8-4c5c-bfab-4ebc7db2b093 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:53.455590 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ab0a9-0772-432c-b0e8-d41cc60f34ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:53.457234 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ab0a9-0772-432c-b0e8-d41cc60f34ee None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:53.457725 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ab0a9-0772-432c-b0e8-d41cc60f34ee None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:53.458349 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ab0a9-0772-432c-b0e8-d41cc60f34ee None admin] PATH_INFO: `/v3/projects/b978d75b349941f5bedbe56544f41ada/users/68a7bf928d4e46c182e22687befcdea8/roles/0ff0d3dcb5e448c3abc2470461490795` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:53.488640 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ab0a9-0772-432c-b0e8-d41cc60f34ee None admin] RBAC: Authorizing `identity:create_grant(project_id=b978d75b349941f5bedbe56544f41ada, user_id=68a7bf928d4e46c182e22687befcdea8, role_id=0ff0d3dcb5e448c3abc2470461490795)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:53.491602 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ab0a9-0772-432c-b0e8-d41cc60f34ee None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:53.526609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 306/619] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:31:53 2022] PUT /identity/v3/projects/b978d75b349941f5bedbe56544f41ada/users/68a7bf928d4e46c182e22687befcdea8/roles/0ff0d3dcb5e448c3abc2470461490795 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:31:53.528059 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ab0a9-0772-432c-b0e8-d41cc60f34ee None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:53.589280 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470955d7-20e8-4c5c-bfab-4ebc7db2b093 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:53.604572 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:53.671123 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b2474-4a10-4028-8070-e506cf2c4a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:53.671741 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b2474-4a10-4028-8070-e506cf2c4a43 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:53.672026 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b2474-4a10-4028-8070-e506cf2c4a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:53.672302 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b2474-4a10-4028-8070-e506cf2c4a43 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:53.673177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b2474-4a10-4028-8070-e506cf2c4a43 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:53.673490 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b2474-4a10-4028-8070-e506cf2c4a43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:53.675041 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b2474-4a10-4028-8070-e506cf2c4a43 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:53.723856 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 314/620] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Jun 15 09:31:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:53.747733 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b2474-4a10-4028-8070-e506cf2c4a43 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:53.756560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ab0a9-0772-432c-b0e8-d41cc60f34ee None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:53.774952 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:53.836648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44be65-2d3c-4de8-89c6-1cc7960c7a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:53.837381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44be65-2d3c-4de8-89c6-1cc7960c7a35 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:53.837669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44be65-2d3c-4de8-89c6-1cc7960c7a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:53.837946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44be65-2d3c-4de8-89c6-1cc7960c7a35 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:53.838913 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44be65-2d3c-4de8-89c6-1cc7960c7a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:53.839097 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44be65-2d3c-4de8-89c6-1cc7960c7a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:53.841566 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44be65-2d3c-4de8-89c6-1cc7960c7a35 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:53.854669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 307/621] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:53.863758 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44be65-2d3c-4de8-89c6-1cc7960c7a35 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:53.955398 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b2474-4a10-4028-8070-e506cf2c4a43 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:54.028644 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3714f5-f87f-41ec-a126-cabca1393e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:54.029468 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3714f5-f87f-41ec-a126-cabca1393e41 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:54.029750 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3714f5-f87f-41ec-a126-cabca1393e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:54.030027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3714f5-f87f-41ec-a126-cabca1393e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:54.047055 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:54.050995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3714f5-f87f-41ec-a126-cabca1393e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:54.053927 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3714f5-f87f-41ec-a126-cabca1393e41 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:54.065518 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44be65-2d3c-4de8-89c6-1cc7960c7a35 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:54.089758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5f3714f5-f87f-41ec-a126-cabca1393e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:54.089758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:54.089758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:54.089758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:54.089758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:54.089758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:54.089758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:54.089758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:54.089758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:54.089758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:54.089758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:54.089758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:54.089758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:54.089758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:54.089758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:54.091503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:54.093229 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:54.093229 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:54.093229 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:54.093229 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:54.093229 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 315/622] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:54.108608 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3714f5-f87f-41ec-a126-cabca1393e41 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:54.143158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c30277-34e5-463a-b8e2-09c1ce55a1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:54.143977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c30277-34e5-463a-b8e2-09c1ce55a1ca None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:54.144258 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c30277-34e5-463a-b8e2-09c1ce55a1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:54.144531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c30277-34e5-463a-b8e2-09c1ce55a1ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:54.157874 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c30277-34e5-463a-b8e2-09c1ce55a1ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:54.159522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c30277-34e5-463a-b8e2-09c1ce55a1ca None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f1c30277-34e5-463a-b8e2-09c1ce55a1ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:31:54.191890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:54.193669 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:54.195638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:54.195638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:54.195638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:31:54.195638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:31:54.195638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:31:54.195638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:31:54.195638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:31:54.195638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:31:54.195638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:31:54.195638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:54.202530 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 308/623] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Jun 15 09:31:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:54.204851 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c30277-34e5-463a-b8e2-09c1ce55a1ca None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:54.223017 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:54.261751 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3714f5-f87f-41ec-a126-cabca1393e41 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:54.324327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc400a02-eb28-43ef-825a-99d4661aade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:54.325015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc400a02-eb28-43ef-825a-99d4661aade6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:54.325300 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc400a02-eb28-43ef-825a-99d4661aade6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:54.325580 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc400a02-eb28-43ef-825a-99d4661aade6 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:54.326321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc400a02-eb28-43ef-825a-99d4661aade6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:54.326667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc400a02-eb28-43ef-825a-99d4661aade6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:54.328395 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc400a02-eb28-43ef-825a-99d4661aade6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:54.343199 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 316/624] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:54.348755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc400a02-eb28-43ef-825a-99d4661aade6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:54.440411 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c30277-34e5-463a-b8e2-09c1ce55a1ca None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:54.521571 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a2e1b-2f21-421e-b325-19b47448e01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:54.522271 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a2e1b-2f21-421e-b325-19b47448e01a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:54.522586 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a2e1b-2f21-421e-b325-19b47448e01a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:54.522868 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a2e1b-2f21-421e-b325-19b47448e01a None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:54.524296 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a2e1b-2f21-421e-b325-19b47448e01a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:54.524610 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a2e1b-2f21-421e-b325-19b47448e01a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:54.526078 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a2e1b-2f21-421e-b325-19b47448e01a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:54.558359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc400a02-eb28-43ef-825a-99d4661aade6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:54.559003 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 309/625] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Jun 15 09:31:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:31:54.560365 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feff5f-2f83-4508-92c6-e0ba20992542 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:54.560663 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feff5f-2f83-4508-92c6-e0ba20992542 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:54.565446 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feff5f-2f83-4508-92c6-e0ba20992542 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:54.570723 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 310/626] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:54.570723 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feff5f-2f83-4508-92c6-e0ba20992542 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:54.584398 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:54.604303 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:54.613150 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da351a-110d-46fe-ae43-157ce4bb80da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:54.613852 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da351a-110d-46fe-ae43-157ce4bb80da None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:54.614231 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da351a-110d-46fe-ae43-157ce4bb80da None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:54.614643 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da351a-110d-46fe-ae43-157ce4bb80da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:54.623062 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da351a-110d-46fe-ae43-157ce4bb80da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:54.625286 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da351a-110d-46fe-ae43-157ce4bb80da None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:54.642540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e1da351a-110d-46fe-ae43-157ce4bb80da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:54.642540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:54.642540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:54.642540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:54.642540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:54.642540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:54.642540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:54.642540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:54.642540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:54.642540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:54.642540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:54.642540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:54.642540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:31:54.642540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:31:54.642540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:54.643567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:54.644496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:31:54.644496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:31:54.644496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:31:54.644496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:31:54.644496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:31:54.644496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:31:54.644496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:54.644496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:54.644944 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 317/627] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:31:54.646537 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118378f8-af5c-4c63-9c19-8eda38610609 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:54.647028 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118378f8-af5c-4c63-9c19-8eda38610609 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:54.647432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118378f8-af5c-4c63-9c19-8eda38610609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:54.667127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-118378f8-af5c-4c63-9c19-8eda38610609 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:54.668375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-118378f8-af5c-4c63-9c19-8eda38610609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:54.719371 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feff5f-2f83-4508-92c6-e0ba20992542 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:54.756296 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 318/628] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:54.758969 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118378f8-af5c-4c63-9c19-8eda38610609 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:54.774305 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffd57b-092a-4d3f-955c-f672621228ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:54.775533 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffd57b-092a-4d3f-955c-f672621228ba None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:54.776413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffd57b-092a-4d3f-955c-f672621228ba None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:54.776920 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffd57b-092a-4d3f-955c-f672621228ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:54.870091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffd57b-092a-4d3f-955c-f672621228ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:54.871601 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffd57b-092a-4d3f-955c-f672621228ba None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:54.882639 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:54.884876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118378f8-af5c-4c63-9c19-8eda38610609 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:54.909528 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:54.936377 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1c23d-3973-4445-857f-f226d9cd4a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:54.937413 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1c23d-3973-4445-857f-f226d9cd4a11 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:54.937868 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1c23d-3973-4445-857f-f226d9cd4a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:54.938325 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1c23d-3973-4445-857f-f226d9cd4a11 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:54.939851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1c23d-3973-4445-857f-f226d9cd4a11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:54.940360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1c23d-3973-4445-857f-f226d9cd4a11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:54.942635 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1c23d-3973-4445-857f-f226d9cd4a11 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:54.966982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 319/629] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:31:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:54.966982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22cfc2-6ba6-4a53-8aca-c2c81e3601a5 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:54.966982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22cfc2-6ba6-4a53-8aca-c2c81e3601a5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:54.966982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22cfc2-6ba6-4a53-8aca-c2c81e3601a5 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:54.966982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 320/630] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:54.967430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22cfc2-6ba6-4a53-8aca-c2c81e3601a5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:55.043041 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 311/631] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:55.043041 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffd57b-092a-4d3f-955c-f672621228ba None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:55.143124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22cfc2-6ba6-4a53-8aca-c2c81e3601a5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:55.184223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021bb9a-de5b-4e9b-881a-2756dd8338a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:55.185223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021bb9a-de5b-4e9b-881a-2756dd8338a7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:55.185706 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021bb9a-de5b-4e9b-881a-2756dd8338a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:55.186152 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021bb9a-de5b-4e9b-881a-2756dd8338a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:55.199743 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021bb9a-de5b-4e9b-881a-2756dd8338a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c021bb9a-de5b-4e9b-881a-2756dd8338a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:55.213228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:55.215884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:55.217084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:55.217084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:55.217084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:55.217084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:55.217084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:55.217084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:55.217084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:55.217084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:55.217084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:55.217084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:55.217084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:55.217084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:55.217084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 321/632] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:55.217084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586651b9-1048-411b-8be4-1e83aa84e5bd None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:55.217851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586651b9-1048-411b-8be4-1e83aa84e5bd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:55.217851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586651b9-1048-411b-8be4-1e83aa84e5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:55.226854 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffd57b-092a-4d3f-955c-f672621228ba None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:55.242756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:55.244037 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-586651b9-1048-411b-8be4-1e83aa84e5bd None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:55.246273 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-586651b9-1048-411b-8be4-1e83aa84e5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:55.283547 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969ccb1-8e70-466b-9e35-e1ecf9e5ce4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:55.284994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969ccb1-8e70-466b-9e35-e1ecf9e5ce4e None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:55.285436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969ccb1-8e70-466b-9e35-e1ecf9e5ce4e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:55.285880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969ccb1-8e70-466b-9e35-e1ecf9e5ce4e None admin] PATH_INFO: `/v3/projects/b978d75b349941f5bedbe56544f41ada/users/cdbfc031f967416e9a2c94bce3d28f66/roles/0ff0d3dcb5e448c3abc2470461490795` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:55.300693 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:55.309986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969ccb1-8e70-466b-9e35-e1ecf9e5ce4e None admin] RBAC: Authorizing `identity:create_grant(project_id=b978d75b349941f5bedbe56544f41ada, user_id=cdbfc031f967416e9a2c94bce3d28f66, role_id=0ff0d3dcb5e448c3abc2470461490795)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:55.311956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969ccb1-8e70-466b-9e35-e1ecf9e5ce4e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:55.334560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 312/633] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:31:55 2022] PUT /identity/v3/projects/b978d75b349941f5bedbe56544f41ada/users/cdbfc031f967416e9a2c94bce3d28f66/roles/0ff0d3dcb5e448c3abc2470461490795 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:31:55.334560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969ccb1-8e70-466b-9e35-e1ecf9e5ce4e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:55.355414 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 322/634] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:55.356915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586651b9-1048-411b-8be4-1e83aa84e5bd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:55.514746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586651b9-1048-411b-8be4-1e83aa84e5bd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:55.540045 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969ccb1-8e70-466b-9e35-e1ecf9e5ce4e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:55.563238 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e3344-bffa-4ad8-b708-dc7fe8c5b751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:55.563949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e3344-bffa-4ad8-b708-dc7fe8c5b751 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:55.564238 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e3344-bffa-4ad8-b708-dc7fe8c5b751 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:55.564522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e3344-bffa-4ad8-b708-dc7fe8c5b751 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:55.565313 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e3344-bffa-4ad8-b708-dc7fe8c5b751 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:55.565627 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e3344-bffa-4ad8-b708-dc7fe8c5b751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:55.567333 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e3344-bffa-4ad8-b708-dc7fe8c5b751 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:55.579025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 323/635] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:31:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:55.580413 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e3344-bffa-4ad8-b708-dc7fe8c5b751 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:55.603401 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd176e78-0bce-4425-ac07-5e46427e6975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:55.604232 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd176e78-0bce-4425-ac07-5e46427e6975 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:55.604517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd176e78-0bce-4425-ac07-5e46427e6975 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:55.604796 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd176e78-0bce-4425-ac07-5e46427e6975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:55.619582 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd176e78-0bce-4425-ac07-5e46427e6975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:55.621391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd176e78-0bce-4425-ac07-5e46427e6975 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:55.644941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-cd176e78-0bce-4425-ac07-5e46427e6975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:55.644941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:55.644941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:55.644941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:55.644941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:55.644941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:55.644941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:55.644941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:55.644941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:55.644941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:55.644941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:55.644941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:55.644941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:55.644941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:55.644941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:55.647512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:55.649407 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:55.649407 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:55.649407 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:55.649407 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:55.649652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:55.649727 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 313/636] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:55.649727 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd176e78-0bce-4425-ac07-5e46427e6975 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:55.672037 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:55.775554 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e3344-bffa-4ad8-b708-dc7fe8c5b751 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:55.836726 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5c2dd-bd82-4c1c-9298-20f46abf6047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:55.838476 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5c2dd-bd82-4c1c-9298-20f46abf6047 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:55.839277 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5c2dd-bd82-4c1c-9298-20f46abf6047 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:55.840000 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5c2dd-bd82-4c1c-9298-20f46abf6047 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:55.843829 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd176e78-0bce-4425-ac07-5e46427e6975 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:55.859729 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5c2dd-bd82-4c1c-9298-20f46abf6047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1bd5c2dd-bd82-4c1c-9298-20f46abf6047 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:55.875283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:55.877142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:55.879417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:55.879417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:55.879417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:55.879417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:55.879417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:55.879417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:55.879417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:55.879417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:55.879417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:55.879417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:55.879417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:55.879417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:55.883730 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 324/637] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:55.885583 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5c2dd-bd82-4c1c-9298-20f46abf6047 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:55.908535 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84198c5b-68bd-40f1-9114-16f8790a81d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:55.909827 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84198c5b-68bd-40f1-9114-16f8790a81d3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:55.910295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84198c5b-68bd-40f1-9114-16f8790a81d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:55.910880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84198c5b-68bd-40f1-9114-16f8790a81d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:55.930284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84198c5b-68bd-40f1-9114-16f8790a81d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:55.933631 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84198c5b-68bd-40f1-9114-16f8790a81d3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:55.967873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-84198c5b-68bd-40f1-9114-16f8790a81d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:55.967873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:55.967873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:55.967873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:55.967873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:55.967873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:55.967873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:55.967873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:55.967873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:55.967873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:55.967873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:55.967873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:55.967873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:55.967873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:55.967873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:55.969696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:55.972125 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:55.972125 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:55.972125 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:55.972125 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:55.972125 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 314/638] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:55.972125 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84198c5b-68bd-40f1-9114-16f8790a81d3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:56.063365 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:56.080901 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5c2dd-bd82-4c1c-9298-20f46abf6047 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:56.095975 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:56.132682 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df658a-a22c-4b6a-8750-049ee0f8d0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:56.133733 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df658a-a22c-4b6a-8750-049ee0f8d0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:56.134123 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df658a-a22c-4b6a-8750-049ee0f8d0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:56.134594 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df658a-a22c-4b6a-8750-049ee0f8d0f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:56.135834 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df658a-a22c-4b6a-8750-049ee0f8d0f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:56.136339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df658a-a22c-4b6a-8750-049ee0f8d0f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:56.138599 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df658a-a22c-4b6a-8750-049ee0f8d0f4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:56.159557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 325/639] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:56.160692 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df658a-a22c-4b6a-8750-049ee0f8d0f4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:56.167189 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84198c5b-68bd-40f1-9114-16f8790a81d3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:56.223133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d5137-be7e-4024-aa1c-e24228cb0713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:56.224188 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d5137-be7e-4024-aa1c-e24228cb0713 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:56.224646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d5137-be7e-4024-aa1c-e24228cb0713 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:56.225100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d5137-be7e-4024-aa1c-e24228cb0713 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:56.226713 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d5137-be7e-4024-aa1c-e24228cb0713 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:56.227220 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d5137-be7e-4024-aa1c-e24228cb0713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:56.229936 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d5137-be7e-4024-aa1c-e24228cb0713 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:56.247789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 315/640] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:31:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:56.247789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539218dc-43ed-4b37-81fc-1514d5c445f6 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:56.247789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539218dc-43ed-4b37-81fc-1514d5c445f6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:56.247789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539218dc-43ed-4b37-81fc-1514d5c445f6 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:56.249208 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 316/641] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:56.253551 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539218dc-43ed-4b37-81fc-1514d5c445f6 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:56.321529 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df658a-a22c-4b6a-8750-049ee0f8d0f4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:56.370011 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095393a-305a-4082-8bea-8e5f45fadfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:56.370820 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095393a-305a-4082-8bea-8e5f45fadfbf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:56.371142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095393a-305a-4082-8bea-8e5f45fadfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:56.371474 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095393a-305a-4082-8bea-8e5f45fadfbf None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:56.372440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095393a-305a-4082-8bea-8e5f45fadfbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:56.372798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095393a-305a-4082-8bea-8e5f45fadfbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:56.374557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095393a-305a-4082-8bea-8e5f45fadfbf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:56.389574 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 326/642] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:56.391384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095393a-305a-4082-8bea-8e5f45fadfbf None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:56.405806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539218dc-43ed-4b37-81fc-1514d5c445f6 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:56.418012 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:56.451430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:56.471093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbb7e1-8538-4a17-ab6f-585b1d0f8907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:56.472389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbb7e1-8538-4a17-ab6f-585b1d0f8907 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:56.472851 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbb7e1-8538-4a17-ab6f-585b1d0f8907 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:56.473348 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbb7e1-8538-4a17-ab6f-585b1d0f8907 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:56.485255 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbb7e1-8538-4a17-ab6f-585b1d0f8907 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:56.487817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbb7e1-8538-4a17-ab6f-585b1d0f8907 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:56.518879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-94cbb7e1-8538-4a17-ab6f-585b1d0f8907 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:56.518879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:56.518879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:56.518879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:56.518879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:56.518879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:56.518879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:56.518879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:56.518879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:56.518879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:56.518879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:56.518879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:56.518879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:31:56.518879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:31:56.518879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:56.520765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:56.522643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:31:56.522643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:31:56.522643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:31:56.522643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:31:56.522643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:31:56.522643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:31:56.522643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:56.522643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:56.527757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 317/643] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:56.529423 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ef8f8-8d90-4521-8842-5e69d1edb2b6 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:56.529845 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ef8f8-8d90-4521-8842-5e69d1edb2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:56.530255 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ef8f8-8d90-4521-8842-5e69d1edb2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:56.553475 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-234ef8f8-8d90-4521-8842-5e69d1edb2b6 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:56.555263 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-234ef8f8-8d90-4521-8842-5e69d1edb2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:56.590851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095393a-305a-4082-8bea-8e5f45fadfbf None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:56.643693 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 318/644] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:56.645039 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ef8f8-8d90-4521-8842-5e69d1edb2b6 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:56.667978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd886b5b-6b78-4fe9-8ead-00ce8ba2d66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:56.669683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd886b5b-6b78-4fe9-8ead-00ce8ba2d66d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:56.670470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd886b5b-6b78-4fe9-8ead-00ce8ba2d66d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:56.671292 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd886b5b-6b78-4fe9-8ead-00ce8ba2d66d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:56.692885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd886b5b-6b78-4fe9-8ead-00ce8ba2d66d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:56.694566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd886b5b-6b78-4fe9-8ead-00ce8ba2d66d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:56.727677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-bd886b5b-6b78-4fe9-8ead-00ce8ba2d66d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:56.727677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:56.727677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:56.727677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:56.727677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:56.727677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:56.727677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:56.727677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:56.727677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:56.727677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:56.727677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:56.727677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:56.727677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:56.727677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:56.727677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:56.728978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:56.730170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:56.730170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:56.730170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:56.730170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:56.730170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 327/645] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:56.732094 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd886b5b-6b78-4fe9-8ead-00ce8ba2d66d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:56.827886 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ef8f8-8d90-4521-8842-5e69d1edb2b6 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:56.840044 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:56.857782 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:56.886604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73918eee-e3ab-492a-92ee-fc478aec40f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:56.887841 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73918eee-e3ab-492a-92ee-fc478aec40f0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:56.888331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73918eee-e3ab-492a-92ee-fc478aec40f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:56.888619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73918eee-e3ab-492a-92ee-fc478aec40f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:56.897649 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73918eee-e3ab-492a-92ee-fc478aec40f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:56.899372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73918eee-e3ab-492a-92ee-fc478aec40f0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:56.903330 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd886b5b-6b78-4fe9-8ead-00ce8ba2d66d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-73918eee-e3ab-492a-92ee-fc478aec40f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:31:56.917372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:56.919406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:56.921290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:56.921290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:56.921290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:31:56.921290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:31:56.921290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:31:56.921290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:31:56.921290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:31:56.921290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:31:56.921290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 09:31:56.921290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:56.921290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 319/646] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:56.921290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73918eee-e3ab-492a-92ee-fc478aec40f0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:56.974083 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86061c7b-c52b-462e-a139-c74bffa46199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:56.975283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86061c7b-c52b-462e-a139-c74bffa46199 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:56.975772 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86061c7b-c52b-462e-a139-c74bffa46199 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:56.976318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86061c7b-c52b-462e-a139-c74bffa46199 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:56.977788 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86061c7b-c52b-462e-a139-c74bffa46199 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:56.978115 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86061c7b-c52b-462e-a139-c74bffa46199 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:56.979593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86061c7b-c52b-462e-a139-c74bffa46199 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:57.000303 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 328/647] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:31:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:57.000303 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86061c7b-c52b-462e-a139-c74bffa46199 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:57.077891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73918eee-e3ab-492a-92ee-fc478aec40f0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:57.141220 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b94d9-ea2e-4b32-865f-feebad0f24d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:57.142652 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b94d9-ea2e-4b32-865f-feebad0f24d9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:57.143241 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b94d9-ea2e-4b32-865f-feebad0f24d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:57.143741 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b94d9-ea2e-4b32-865f-feebad0f24d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:57.159306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86061c7b-c52b-462e-a139-c74bffa46199 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:57.163450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b94d9-ea2e-4b32-865f-feebad0f24d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3a6b94d9-ea2e-4b32-865f-feebad0f24d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:57.178553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:57.180175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:57.181016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:57.181016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:57.181016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:57.181016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:57.181016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:57.181016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:57.181016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:57.181016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:57.181016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:57.181016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:57.181016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:57.181016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:57.182157 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 320/648] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:57.183323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b94d9-ea2e-4b32-865f-feebad0f24d9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:57.204169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:57.223510 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b722ca3-774d-4d26-89fc-9017c30c7ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:57.224567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b722ca3-774d-4d26-89fc-9017c30c7ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:57.224856 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b722ca3-774d-4d26-89fc-9017c30c7ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:57.225286 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b722ca3-774d-4d26-89fc-9017c30c7ab2 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:57.227531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b722ca3-774d-4d26-89fc-9017c30c7ab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:57.228136 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b722ca3-774d-4d26-89fc-9017c30c7ab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:57.230670 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b722ca3-774d-4d26-89fc-9017c30c7ab2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:57.239640 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:57.256692 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 329/649] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:57.256692 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b722ca3-774d-4d26-89fc-9017c30c7ab2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:57.380607 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b94d9-ea2e-4b32-865f-feebad0f24d9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:57.394896 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b722ca3-774d-4d26-89fc-9017c30c7ab2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:57.438111 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f85df-b213-465a-a97f-0c2eddbe9a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:57.439170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f85df-b213-465a-a97f-0c2eddbe9a6f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:57.439666 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f85df-b213-465a-a97f-0c2eddbe9a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:57.440124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f85df-b213-465a-a97f-0c2eddbe9a6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:57.441168 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f85df-b213-465a-a97f-0c2eddbe9a6f None admin] RBAC: Adding query filter params (role.id=0ff0d3dcb5e448c3abc2470461490795, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=26dbaf7292444c8f9a6d45bfaf96763f) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:57.441682 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f85df-b213-465a-a97f-0c2eddbe9a6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:57.443377 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f85df-b213-465a-a97f-0c2eddbe9a6f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:57.449024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce66ae4-be93-448d-8990-9502cbf6937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:57.450203 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66ae4-be93-448d-8990-9502cbf6937e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:57.450756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66ae4-be93-448d-8990-9502cbf6937e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:57.451267 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66ae4-be93-448d-8990-9502cbf6937e None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:57.452561 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 330/650] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:31:57 2022] GET /identity/v3/role_assignments?user.id=26dbaf7292444c8f9a6d45bfaf96763f&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=0ff0d3dcb5e448c3abc2470461490795 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:57.452953 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce66ae4-be93-448d-8990-9502cbf6937e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:57.453510 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce66ae4-be93-448d-8990-9502cbf6937e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:57.453969 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f85df-b213-465a-a97f-0c2eddbe9a6f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:57.456334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce66ae4-be93-448d-8990-9502cbf6937e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:57.504524 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 321/651] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Jun 15 09:31:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:57.504524 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce66ae4-be93-448d-8990-9502cbf6937e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:57.533992 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:57.606011 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f85df-b213-465a-a97f-0c2eddbe9a6f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:57.653453 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ab6a5-7d6e-4f92-8135-026a1756fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:57.654985 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ab6a5-7d6e-4f92-8135-026a1756fefa None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:57.655536 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ab6a5-7d6e-4f92-8135-026a1756fefa None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:57.656001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ab6a5-7d6e-4f92-8135-026a1756fefa None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:57.657024 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ab6a5-7d6e-4f92-8135-026a1756fefa None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:57.657581 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ab6a5-7d6e-4f92-8135-026a1756fefa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:57.659334 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ab6a5-7d6e-4f92-8135-026a1756fefa None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:57.671140 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 331/652] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:31:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:57.672458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ab6a5-7d6e-4f92-8135-026a1756fefa None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:57.708410 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:57.725188 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce66ae4-be93-448d-8990-9502cbf6937e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:57.788258 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22f2f1-e591-47b7-8006-075ff0a226c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:57.789725 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22f2f1-e591-47b7-8006-075ff0a226c0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:57.790007 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22f2f1-e591-47b7-8006-075ff0a226c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:57.790281 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22f2f1-e591-47b7-8006-075ff0a226c0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:57.798699 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22f2f1-e591-47b7-8006-075ff0a226c0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:57.800192 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22f2f1-e591-47b7-8006-075ff0a226c0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:57.821111 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ab6a5-7d6e-4f92-8135-026a1756fefa None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-fb22f2f1-e591-47b7-8006-075ff0a226c0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:31:57.831606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:57.832731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:57.833818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:57.833818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:57.833818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:31:57.833818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:31:57.833818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:31:57.833818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:31:57.833818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:31:57.833818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:31:57.833818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 09:31:57.833818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:57.834415 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 322/653] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:31:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:57.836328 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22f2f1-e591-47b7-8006-075ff0a226c0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:57.838344 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:57.871488 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232da841-a84e-4e0f-a9e0-34e208741a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:57.872454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232da841-a84e-4e0f-a9e0-34e208741a5f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:57.872743 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232da841-a84e-4e0f-a9e0-34e208741a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:57.873021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232da841-a84e-4e0f-a9e0-34e208741a5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:57.949467 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232da841-a84e-4e0f-a9e0-34e208741a5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:57.950976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232da841-a84e-4e0f-a9e0-34e208741a5f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:58.003840 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22f2f1-e591-47b7-8006-075ff0a226c0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:58.066245 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 332/654] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:58.066245 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbb201-914f-4d8c-ad43-d5035c99673d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:58.066245 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbb201-914f-4d8c-ad43-d5035c99673d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:58.066245 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbb201-914f-4d8c-ad43-d5035c99673d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:58.066245 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 333/655] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:31:58.066245 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbb201-914f-4d8c-ad43-d5035c99673d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:58.076203 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7c06c-55fc-4f9f-ad2b-169587bedd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:58.077329 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7c06c-55fc-4f9f-ad2b-169587bedd8a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:58.077770 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7c06c-55fc-4f9f-ad2b-169587bedd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:58.078235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7c06c-55fc-4f9f-ad2b-169587bedd8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:58.084270 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:58.095460 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7c06c-55fc-4f9f-ad2b-169587bedd8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:58.098069 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7c06c-55fc-4f9f-ad2b-169587bedd8a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:58.119870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-10d7c06c-55fc-4f9f-ad2b-169587bedd8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:58.119870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:58.119870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:58.119870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:58.119870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:58.119870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:58.119870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:58.119870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:58.119870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:58.119870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:58.119870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:58.119870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:58.119870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:58.119870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:58.119870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:58.120865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:58.121813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:58.121813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:58.121813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:58.121813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:58.121813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 323/656] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:58.122612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7c06c-55fc-4f9f-ad2b-169587bedd8a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:58.128878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:58.215145 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbb201-914f-4d8c-ad43-d5035c99673d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:58.265907 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5735543-14f1-45a7-8d35-f6fe7ab4008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:58.267314 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5735543-14f1-45a7-8d35-f6fe7ab4008b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:58.267753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5735543-14f1-45a7-8d35-f6fe7ab4008b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:58.268164 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5735543-14f1-45a7-8d35-f6fe7ab4008b None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:58.269650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5735543-14f1-45a7-8d35-f6fe7ab4008b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:58.270104 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5735543-14f1-45a7-8d35-f6fe7ab4008b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:58.271914 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5735543-14f1-45a7-8d35-f6fe7ab4008b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:58.300059 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 334/657] 10.222.0.45 () {56 vars in 1137 bytes} [Wed Jun 15 09:31:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:58.301940 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460dfda-ca80-4166-808f-efe76f8add3d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:58.302361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460dfda-ca80-4166-808f-efe76f8add3d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:58.302813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460dfda-ca80-4166-808f-efe76f8add3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:58.315314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7c06c-55fc-4f9f-ad2b-169587bedd8a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:58.324285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f460dfda-ca80-4166-808f-efe76f8add3d None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:31:58.325782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f460dfda-ca80-4166-808f-efe76f8add3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:31:58.381712 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ee982-6f58-4f3a-b4b8-2f5baefd9b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:58.383690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ee982-6f58-4f3a-b4b8-2f5baefd9b57 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:58.384194 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ee982-6f58-4f3a-b4b8-2f5baefd9b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:58.384676 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ee982-6f58-4f3a-b4b8-2f5baefd9b57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:58.403201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ee982-6f58-4f3a-b4b8-2f5baefd9b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:58.405069 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ee982-6f58-4f3a-b4b8-2f5baefd9b57 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:58.412675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:58.430628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 335/658] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:31:58.430628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460dfda-ca80-4166-808f-efe76f8add3d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:58.432657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-4a4ee982-6f58-4f3a-b4b8-2f5baefd9b57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:58.432657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:58.432657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:58.432657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:58.432657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:58.432657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:58.432657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:58.432657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:58.432657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:58.432657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:58.432657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:58.432657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:58.432657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:58.432657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:58.432657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:58.433672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:58.434887 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:58.434887 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:58.434887 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:58.434887 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:58.435427 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 324/659] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:58.436820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ee982-6f58-4f3a-b4b8-2f5baefd9b57 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:58.543782 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:58.580196 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460dfda-ca80-4166-808f-efe76f8add3d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:58.603233 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ee982-6f58-4f3a-b4b8-2f5baefd9b57 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:58.634422 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264fcf3-4df8-4b86-8ce4-da381e351031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:58.635457 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264fcf3-4df8-4b86-8ce4-da381e351031 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:58.635900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264fcf3-4df8-4b86-8ce4-da381e351031 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:58.636198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264fcf3-4df8-4b86-8ce4-da381e351031 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:58.636941 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264fcf3-4df8-4b86-8ce4-da381e351031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:58.637250 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264fcf3-4df8-4b86-8ce4-da381e351031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:58.638688 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264fcf3-4df8-4b86-8ce4-da381e351031 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:58.648586 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d38cb-e7ec-4920-a9a4-33c47e9a8f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:58.649586 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d38cb-e7ec-4920-a9a4-33c47e9a8f69 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:58.649890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d38cb-e7ec-4920-a9a4-33c47e9a8f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:58.650165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d38cb-e7ec-4920-a9a4-33c47e9a8f69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:58.660250 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 336/660] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:58.660250 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264fcf3-4df8-4b86-8ce4-da381e351031 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:58.743965 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:58.756281 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d38cb-e7ec-4920-a9a4-33c47e9a8f69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:58.759451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d38cb-e7ec-4920-a9a4-33c47e9a8f69 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:58.805930 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264fcf3-4df8-4b86-8ce4-da381e351031 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:58.844926 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac60e4-2fb5-43a3-a135-a6b8dd34ff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:58.845851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac60e4-2fb5-43a3-a135-a6b8dd34ff49 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:58.845851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac60e4-2fb5-43a3-a135-a6b8dd34ff49 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:58.846147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac60e4-2fb5-43a3-a135-a6b8dd34ff49 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:58.846644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:58.846914 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac60e4-2fb5-43a3-a135-a6b8dd34ff49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:58.847217 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac60e4-2fb5-43a3-a135-a6b8dd34ff49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:58.848962 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac60e4-2fb5-43a3-a135-a6b8dd34ff49 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:58.866409 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 337/661] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:58.866409 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac60e4-2fb5-43a3-a135-a6b8dd34ff49 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:58.924142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 325/662] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:31:58.929874 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d38cb-e7ec-4920-a9a4-33c47e9a8f69 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:59.024057 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac60e4-2fb5-43a3-a135-a6b8dd34ff49 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:59.044941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d38cb-e7ec-4920-a9a4-33c47e9a8f69 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:59.054672 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:59.075263 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2856c-b22e-4061-a2c7-5096a5454c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:59.076199 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2856c-b22e-4061-a2c7-5096a5454c57 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:59.076582 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2856c-b22e-4061-a2c7-5096a5454c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:59.076958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2856c-b22e-4061-a2c7-5096a5454c57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:59.088770 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2856c-b22e-4061-a2c7-5096a5454c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-76b2856c-b22e-4061-a2c7-5096a5454c57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:31:59.096843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:59.098079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:59.099359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:59.099359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:59.099359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:59.099359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:59.099359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:31:59.099359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:31:59.099359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:31:59.099359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:31:59.099359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:31:59.099359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:31:59.099359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:31:59.099359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:59.105734 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 338/663] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:59.105734 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2856c-b22e-4061-a2c7-5096a5454c57 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:59.108660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580254e6-3bb9-4079-8929-c475eae8f40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:59.110217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580254e6-3bb9-4079-8929-c475eae8f40f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:59.110976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580254e6-3bb9-4079-8929-c475eae8f40f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:59.111686 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580254e6-3bb9-4079-8929-c475eae8f40f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:59.125921 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580254e6-3bb9-4079-8929-c475eae8f40f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:59.128803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580254e6-3bb9-4079-8929-c475eae8f40f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-580254e6-3bb9-4079-8929-c475eae8f40f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:31:59.146381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:59.152282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:59.153537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:59.153537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:59.153537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:31:59.153537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:31:59.153537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:31:59.153537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:31:59.153537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:31:59.153537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:31:59.153537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 09:31:59.153537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:59.153537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 326/664] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:31:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:59.153537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580254e6-3bb9-4079-8929-c475eae8f40f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:59.171762 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:59.262270 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580254e6-3bb9-4079-8929-c475eae8f40f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:59.267192 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2856c-b22e-4061-a2c7-5096a5454c57 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:59.302602 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e2b91-73c6-4094-98a9-4977058006ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:59.303411 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e2b91-73c6-4094-98a9-4977058006ae None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:59.303701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e2b91-73c6-4094-98a9-4977058006ae None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:59.304504 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e2b91-73c6-4094-98a9-4977058006ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:59.309111 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5176f-9b6d-4933-9a57-5a7ccbbc58f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:59.310174 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5176f-9b6d-4933-9a57-5a7ccbbc58f5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:59.310642 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5176f-9b6d-4933-9a57-5a7ccbbc58f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:59.311078 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5176f-9b6d-4933-9a57-5a7ccbbc58f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:59.316073 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e2b91-73c6-4094-98a9-4977058006ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:59.317588 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e2b91-73c6-4094-98a9-4977058006ae None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:59.321866 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5176f-9b6d-4933-9a57-5a7ccbbc58f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:59.323582 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5176f-9b6d-4933-9a57-5a7ccbbc58f5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:59.336707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-e67e2b91-73c6-4094-98a9-4977058006ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:59.336707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:59.336707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:59.336707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:59.336707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:59.336707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:59.336707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:59.336707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:59.336707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:59.336707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:59.336707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:59.336707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:59.336707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:31:59.336707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:31:59.336707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:59.337756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:59.338692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:31:59.338692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:31:59.338692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:31:59.338692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:31:59.338692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 327/665] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:59.339280 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e2b91-73c6-4094-98a9-4977058006ae None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:59.353459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d3a5176f-9b6d-4933-9a57-5a7ccbbc58f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:59.353459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:31:59.353459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:31:59.353459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:31:59.353459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:31:59.353459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:31:59.353459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:31:59.353459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:31:59.353459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:31:59.353459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:31:59.353459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:31:59.353459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:31:59.353459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:31:59.353459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:31:59.353459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:31:59.354430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:31:59.355382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:31:59.355382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:31:59.355382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:31:59.355382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:31:59.355382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:31:59.355382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:31:59.355382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:31:59.355382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:31:59.355869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 339/666] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:31:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:31:59.357255 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5176f-9b6d-4933-9a57-5a7ccbbc58f5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:59.425599 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:59.428173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:59.484060 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e2b91-73c6-4094-98a9-4977058006ae None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:59.500271 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5176f-9b6d-4933-9a57-5a7ccbbc58f5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:59.546536 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd1c08-49f7-4c08-9b99-24c2343ed1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:59.547492 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd1c08-49f7-4c08-9b99-24c2343ed1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:59.548123 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd1c08-49f7-4c08-9b99-24c2343ed1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:59.548588 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd1c08-49f7-4c08-9b99-24c2343ed1a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:59.549867 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd1c08-49f7-4c08-9b99-24c2343ed1a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:59.550379 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd1c08-49f7-4c08-9b99-24c2343ed1a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:59.552804 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd1c08-49f7-4c08-9b99-24c2343ed1a5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:59.553619 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8c769-1119-4e31-907e-882024dfaa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:59.554695 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8c769-1119-4e31-907e-882024dfaa01 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:59.555150 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8c769-1119-4e31-907e-882024dfaa01 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:59.555611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8c769-1119-4e31-907e-882024dfaa01 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:59.556959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8c769-1119-4e31-907e-882024dfaa01 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:59.557482 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8c769-1119-4e31-907e-882024dfaa01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:59.559972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8c769-1119-4e31-907e-882024dfaa01 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:59.576023 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 328/667] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:31:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:59.576023 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd1c08-49f7-4c08-9b99-24c2343ed1a5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:59.590959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 340/668] 10.222.0.45 () {56 vars in 1139 bytes} [Wed Jun 15 09:31:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:59.593350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8c769-1119-4e31-907e-882024dfaa01 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:59.709528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd1c08-49f7-4c08-9b99-24c2343ed1a5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:59.748561 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:59.758221 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7876876-c74c-48dd-84fa-7b4d7fbca441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:59.758974 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7876876-c74c-48dd-84fa-7b4d7fbca441 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:59.759250 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7876876-c74c-48dd-84fa-7b4d7fbca441 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:59.759664 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7876876-c74c-48dd-84fa-7b4d7fbca441 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:59.760247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7876876-c74c-48dd-84fa-7b4d7fbca441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:59.760547 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7876876-c74c-48dd-84fa-7b4d7fbca441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:59.761950 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7876876-c74c-48dd-84fa-7b4d7fbca441 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:59.766474 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:31:59.775355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8c769-1119-4e31-907e-882024dfaa01 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:59.777647 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 329/669] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:59.778480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7876876-c74c-48dd-84fa-7b4d7fbca441 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:59.817475 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6954f-089d-4694-84dc-8f830245d290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:59.818151 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6954f-089d-4694-84dc-8f830245d290 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:31:59.818436 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6954f-089d-4694-84dc-8f830245d290 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:31:59.818743 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6954f-089d-4694-84dc-8f830245d290 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:31:59.820073 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6954f-089d-4694-84dc-8f830245d290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:31:59.820384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6954f-089d-4694-84dc-8f830245d290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:31:59.821829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6954f-089d-4694-84dc-8f830245d290 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:31:59.834400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 341/670] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:31:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:31:59.835881 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6954f-089d-4694-84dc-8f830245d290 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:31:59.947914 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7876876-c74c-48dd-84fa-7b4d7fbca441 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:59.953747 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6954f-089d-4694-84dc-8f830245d290 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:31:59.998887 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad2abf-b26a-47d0-9785-6a24dd0a4258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:31:59.999939 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad2abf-b26a-47d0-9785-6a24dd0a4258 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:00.000378 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad2abf-b26a-47d0-9785-6a24dd0a4258 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:00.000766 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad2abf-b26a-47d0-9785-6a24dd0a4258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:00.001719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86ae3d-ea9d-4d76-b2b4-07b3f5effbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:00.002455 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86ae3d-ea9d-4d76-b2b4-07b3f5effbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:00.002831 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86ae3d-ea9d-4d76-b2b4-07b3f5effbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:00.003179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86ae3d-ea9d-4d76-b2b4-07b3f5effbe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:00.015348 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad2abf-b26a-47d0-9785-6a24dd0a4258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:00.017205 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad2abf-b26a-47d0-9785-6a24dd0a4258 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:00.037213 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:00.041134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-8fad2abf-b26a-47d0-9785-6a24dd0a4258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:00.041134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:00.041134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:00.041134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:00.041134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:00.041134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:00.041134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:00.041134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:00.041134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:00.041134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:00.041134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:00.041134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:00.041134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:00.041134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:00.041134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:00.043147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:00.054994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:00.054994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:00.054994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:00.054994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:00.054994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 330/671] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:00.054994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad2abf-b26a-47d0-9785-6a24dd0a4258 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:00.104345 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:00.109701 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86ae3d-ea9d-4d76-b2b4-07b3f5effbe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:00.111632 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86ae3d-ea9d-4d76-b2b4-07b3f5effbe8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:00.180562 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad2abf-b26a-47d0-9785-6a24dd0a4258 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:00.237540 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093ba63-483d-411f-9567-1f18243a4316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:00.238752 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093ba63-483d-411f-9567-1f18243a4316 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:00.239219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093ba63-483d-411f-9567-1f18243a4316 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:00.239668 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093ba63-483d-411f-9567-1f18243a4316 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:00.240833 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 342/672] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:32:00.242669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86ae3d-ea9d-4d76-b2b4-07b3f5effbe8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:00.251120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093ba63-483d-411f-9567-1f18243a4316 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:00.253647 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093ba63-483d-411f-9567-1f18243a4316 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:00.271604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-0093ba63-483d-411f-9567-1f18243a4316 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:00.271604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:00.271604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:00.271604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:00.271604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:00.271604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:00.271604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:00.271604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:00.271604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:00.271604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:00.271604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:00.271604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:00.271604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:00.271604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:00.271604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:00.273451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:00.276594 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:00.276594 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:00.276594 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:00.276594 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:00.276594 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:00.276594 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:00.276594 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:00.276594 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:00.276594 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 331/673] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:00.276594 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093ba63-483d-411f-9567-1f18243a4316 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:00.320442 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:00.379382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86ae3d-ea9d-4d76-b2b4-07b3f5effbe8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:00.404559 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093ba63-483d-411f-9567-1f18243a4316 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:00.406266 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:00.427318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f1f45-8d11-48b7-b6b9-2825d9e787f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:00.428440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f1f45-8d11-48b7-b6b9-2825d9e787f4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:00.429424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f1f45-8d11-48b7-b6b9-2825d9e787f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:00.429930 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f1f45-8d11-48b7-b6b9-2825d9e787f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:00.431587 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f1f45-8d11-48b7-b6b9-2825d9e787f4 None admin] RBAC: Adding query filter params (role.id=0ff0d3dcb5e448c3abc2470461490795, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=303c1175b5d24b0d8a929c7905a4c17c) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:00.432144 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f1f45-8d11-48b7-b6b9-2825d9e787f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:00.434962 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f1f45-8d11-48b7-b6b9-2825d9e787f4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:00.441852 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a595509-7c79-4d39-bbad-4a35b1a6c584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:00.442563 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a595509-7c79-4d39-bbad-4a35b1a6c584 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:00.442851 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a595509-7c79-4d39-bbad-4a35b1a6c584 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:00.443127 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a595509-7c79-4d39-bbad-4a35b1a6c584 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:00.443869 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a595509-7c79-4d39-bbad-4a35b1a6c584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:00.444178 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a595509-7c79-4d39-bbad-4a35b1a6c584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:00.446144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a595509-7c79-4d39-bbad-4a35b1a6c584 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:00.458599 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 343/674] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:32:00 2022] GET /identity/v3/role_assignments?user.id=303c1175b5d24b0d8a929c7905a4c17c&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=0ff0d3dcb5e448c3abc2470461490795 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:00.458599 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712ebf0-f7ed-4894-8fd9-4c05c5ad3e12 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:00.458599 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712ebf0-f7ed-4894-8fd9-4c05c5ad3e12 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:00.458599 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712ebf0-f7ed-4894-8fd9-4c05c5ad3e12 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:00.458599 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 344/675] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:00.458599 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712ebf0-f7ed-4894-8fd9-4c05c5ad3e12 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:00.466195 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 332/676] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:00.466195 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a595509-7c79-4d39-bbad-4a35b1a6c584 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:00.622808 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712ebf0-f7ed-4894-8fd9-4c05c5ad3e12 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:00.645819 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a595509-7c79-4d39-bbad-4a35b1a6c584 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:00.659814 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:00.687294 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb482113-0188-4544-a62e-1ad7cc613d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:00.688808 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb482113-0188-4544-a62e-1ad7cc613d9d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:00.689412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb482113-0188-4544-a62e-1ad7cc613d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:00.689982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb482113-0188-4544-a62e-1ad7cc613d9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:00.706921 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb482113-0188-4544-a62e-1ad7cc613d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:00.708023 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a9746-e01b-4d75-b69c-1515aa379c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:00.708481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb482113-0188-4544-a62e-1ad7cc613d9d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:00.708894 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a9746-e01b-4d75-b69c-1515aa379c06 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:00.709264 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a9746-e01b-4d75-b69c-1515aa379c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:00.709656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a9746-e01b-4d75-b69c-1515aa379c06 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:00.711038 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a9746-e01b-4d75-b69c-1515aa379c06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:00.711441 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a9746-e01b-4d75-b69c-1515aa379c06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:00.713081 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a9746-e01b-4d75-b69c-1515aa379c06 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:00.732858 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 333/677] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:00.735001 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303545cc-f82a-4afb-a29d-cd506def7a1e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:00.735477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303545cc-f82a-4afb-a29d-cd506def7a1e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:00.735938 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303545cc-f82a-4afb-a29d-cd506def7a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:00.738767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-fb482113-0188-4544-a62e-1ad7cc613d9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:00.738767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:00.738767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:00.738767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:00.738767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:00.738767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:00.738767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:00.738767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:00.738767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:00.738767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:00.738767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:00.738767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:00.738767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:00.738767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:00.738767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:00.740707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:00.743199 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:00.743199 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:00.743199 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:00.743199 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:00.745658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 345/678] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:00.746891 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb482113-0188-4544-a62e-1ad7cc613d9d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:00.765692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-303545cc-f82a-4afb-a29d-cd506def7a1e None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:00.767250 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-303545cc-f82a-4afb-a29d-cd506def7a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:00.797667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:00.885919 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 334/679] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:32:00.887333 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303545cc-f82a-4afb-a29d-cd506def7a1e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:00.930990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb482113-0188-4544-a62e-1ad7cc613d9d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:00.974671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a4b58-fce9-4c8c-8fec-70f0cc5c1a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:00.976268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a4b58-fce9-4c8c-8fec-70f0cc5c1a14 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:00.976702 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a4b58-fce9-4c8c-8fec-70f0cc5c1a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:00.977133 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a4b58-fce9-4c8c-8fec-70f0cc5c1a14 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:00.987782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a4b58-fce9-4c8c-8fec-70f0cc5c1a14 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:00.989401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a4b58-fce9-4c8c-8fec-70f0cc5c1a14 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-b09a4b58-fce9-4c8c-8fec-70f0cc5c1a14 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:32:01.007001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:01.009110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:01.011321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:01.011321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:01.011321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:32:01.011321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:32:01.011321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:32:01.011321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:32:01.011321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:32:01.011321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:32:01.011321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 09:32:01.011321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:01.014823 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 346/680] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:32:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:01.018838 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a4b58-fce9-4c8c-8fec-70f0cc5c1a14 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:01.076572 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:01.077201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303545cc-f82a-4afb-a29d-cd506def7a1e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:01.115986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33adc3c-8114-46f3-ab71-b555f049b563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:01.116701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33adc3c-8114-46f3-ab71-b555f049b563 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:01.116983 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33adc3c-8114-46f3-ab71-b555f049b563 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:01.117294 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33adc3c-8114-46f3-ab71-b555f049b563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:01.118172 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33adc3c-8114-46f3-ab71-b555f049b563 None admin] RBAC: Adding query filter params (role.id=0ff0d3dcb5e448c3abc2470461490795, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=e6608bed12f746b89527a80b05459e5e) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:01.118515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33adc3c-8114-46f3-ab71-b555f049b563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:01.119962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33adc3c-8114-46f3-ab71-b555f049b563 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:01.127124 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 335/681] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:32:00 2022] GET /identity/v3/role_assignments?user.id=e6608bed12f746b89527a80b05459e5e&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=0ff0d3dcb5e448c3abc2470461490795 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:01.127735 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33adc3c-8114-46f3-ab71-b555f049b563 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:01.160043 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:01.195714 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a4b58-fce9-4c8c-8fec-70f0cc5c1a14 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:01.254326 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50211c14-362d-4dee-82f9-2086f2e8b380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:01.255356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50211c14-362d-4dee-82f9-2086f2e8b380 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:01.255648 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50211c14-362d-4dee-82f9-2086f2e8b380 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:01.255935 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50211c14-362d-4dee-82f9-2086f2e8b380 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:01.257664 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50211c14-362d-4dee-82f9-2086f2e8b380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:01.258532 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50211c14-362d-4dee-82f9-2086f2e8b380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:01.260283 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50211c14-362d-4dee-82f9-2086f2e8b380 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:01.264975 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33adc3c-8114-46f3-ab71-b555f049b563 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:01.281509 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 347/682] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:01.282522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50211c14-362d-4dee-82f9-2086f2e8b380 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:01.314687 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4829330-4b16-4723-9cab-94f5e9c0a2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:01.315624 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4829330-4b16-4723-9cab-94f5e9c0a2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:01.315909 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4829330-4b16-4723-9cab-94f5e9c0a2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:01.316182 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4829330-4b16-4723-9cab-94f5e9c0a2c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:01.332617 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4829330-4b16-4723-9cab-94f5e9c0a2c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-c4829330-4b16-4723-9cab-94f5e9c0a2c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:32:01.342130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:01.343314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:01.344166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:01.344166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:01.344166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:01.344166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:01.344166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:32:01.344166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:32:01.344166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:32:01.344166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:32:01.344166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:32:01.344166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:32:01.344166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:32:01.344166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:01.348572 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 336/683] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:32:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:01.349503 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4829330-4b16-4723-9cab-94f5e9c0a2c1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:01.415642 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:01.429593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50211c14-362d-4dee-82f9-2086f2e8b380 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:01.467196 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:01.475631 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca37c19-48ee-44c0-b88b-25c104997a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:01.476596 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca37c19-48ee-44c0-b88b-25c104997a42 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:01.477048 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca37c19-48ee-44c0-b88b-25c104997a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:01.477494 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca37c19-48ee-44c0-b88b-25c104997a42 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:01.478524 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca37c19-48ee-44c0-b88b-25c104997a42 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:01.479011 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca37c19-48ee-44c0-b88b-25c104997a42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:01.480540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca37c19-48ee-44c0-b88b-25c104997a42 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:01.498079 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4829330-4b16-4723-9cab-94f5e9c0a2c1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:01.501228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 348/684] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Jun 15 09:32:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:01.502117 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca37c19-48ee-44c0-b88b-25c104997a42 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:01.541992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deda586-2851-4bbc-b6f6-accb75da26b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:01.543238 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deda586-2851-4bbc-b6f6-accb75da26b7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:01.543525 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deda586-2851-4bbc-b6f6-accb75da26b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:01.543804 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deda586-2851-4bbc-b6f6-accb75da26b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:01.555723 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deda586-2851-4bbc-b6f6-accb75da26b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:01.557497 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deda586-2851-4bbc-b6f6-accb75da26b7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:01.581202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9deda586-2851-4bbc-b6f6-accb75da26b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:01.581202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:01.581202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:01.581202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:01.581202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:01.581202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:01.581202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:01.581202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:01.581202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:01.581202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:01.581202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:01.581202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:01.581202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:01.581202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:01.581202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:01.582391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:01.583527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:01.583527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:01.583527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:01.583527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:01.583527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:01.583527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:01.583527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:01.583527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:01.590635 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 337/685] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:01.590635 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deda586-2851-4bbc-b6f6-accb75da26b7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:01.654189 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca37c19-48ee-44c0-b88b-25c104997a42 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:01.706532 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeefa5d-d68b-44b6-8d0f-21d811683b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:01.707722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeefa5d-d68b-44b6-8d0f-21d811683b36 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:01.708528 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeefa5d-d68b-44b6-8d0f-21d811683b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:01.709227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeefa5d-d68b-44b6-8d0f-21d811683b36 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:01.710721 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeefa5d-d68b-44b6-8d0f-21d811683b36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:01.711201 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeefa5d-d68b-44b6-8d0f-21d811683b36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:01.711905 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deda586-2851-4bbc-b6f6-accb75da26b7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:01.712884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeefa5d-d68b-44b6-8d0f-21d811683b36 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:01.726179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 349/686] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:32:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:01.727480 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeefa5d-d68b-44b6-8d0f-21d811683b36 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:01.751622 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:01.759200 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db83d9-2660-41bc-b310-dded7a96618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:01.760028 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db83d9-2660-41bc-b310-dded7a96618c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:01.760423 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db83d9-2660-41bc-b310-dded7a96618c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:01.760810 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db83d9-2660-41bc-b310-dded7a96618c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:01.766415 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:01.854335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db83d9-2660-41bc-b310-dded7a96618c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:01.856257 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db83d9-2660-41bc-b310-dded7a96618c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:01.888941 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeefa5d-d68b-44b6-8d0f-21d811683b36 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:01.939197 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3ac3f-b921-4a49-a203-d74365559dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:01.940167 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3ac3f-b921-4a49-a203-d74365559dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:01.940597 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3ac3f-b921-4a49-a203-d74365559dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:01.941015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3ac3f-b921-4a49-a203-d74365559dc1 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:01.941956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3ac3f-b921-4a49-a203-d74365559dc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:01.942422 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3ac3f-b921-4a49-a203-d74365559dc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:01.944809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3ac3f-b921-4a49-a203-d74365559dc1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:01.968356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 350/687] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:01.969676 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3ac3f-b921-4a49-a203-d74365559dc1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:01.998693 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 338/688] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:32:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:32:02.000543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db83d9-2660-41bc-b310-dded7a96618c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:02.064247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:02.073995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:02.114054 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3ac3f-b921-4a49-a203-d74365559dc1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:02.177431 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716a0b2-0f41-4f5e-ad29-de24dfb785b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:02.179257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716a0b2-0f41-4f5e-ad29-de24dfb785b2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:02.179773 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716a0b2-0f41-4f5e-ad29-de24dfb785b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:02.180225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716a0b2-0f41-4f5e-ad29-de24dfb785b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:02.182944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db83d9-2660-41bc-b310-dded7a96618c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:02.194875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716a0b2-0f41-4f5e-ad29-de24dfb785b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:02.196576 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716a0b2-0f41-4f5e-ad29-de24dfb785b2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:02.221404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2716a0b2-0f41-4f5e-ad29-de24dfb785b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:02.221404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:02.221404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:02.221404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:02.221404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:02.221404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:02.221404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:02.221404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:02.221404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:02.221404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:02.221404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:02.221404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:02.221404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:02.221404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:02.221404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:02.222388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:02.223951 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:02.223951 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:02.223951 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:02.223951 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:02.230727 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 351/689] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:02.234854 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716a0b2-0f41-4f5e-ad29-de24dfb785b2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:02.255760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a1ccf-21d6-40e3-83d1-c9e7883880b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:02.256441 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a1ccf-21d6-40e3-83d1-c9e7883880b2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:02.257257 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a1ccf-21d6-40e3-83d1-c9e7883880b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:02.257538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a1ccf-21d6-40e3-83d1-c9e7883880b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:02.258448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a1ccf-21d6-40e3-83d1-c9e7883880b2 None admin] RBAC: Adding query filter params (role.id=0ff0d3dcb5e448c3abc2470461490795, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=68a7bf928d4e46c182e22687befcdea8) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:02.258806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a1ccf-21d6-40e3-83d1-c9e7883880b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:02.260481 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a1ccf-21d6-40e3-83d1-c9e7883880b2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:02.274615 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 339/690] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:32:01 2022] GET /identity/v3/role_assignments?user.id=68a7bf928d4e46c182e22687befcdea8&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=0ff0d3dcb5e448c3abc2470461490795 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:02.276151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a1ccf-21d6-40e3-83d1-c9e7883880b2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:02.465261 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:02.474281 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a1ccf-21d6-40e3-83d1-c9e7883880b2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:02.504904 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716a0b2-0f41-4f5e-ad29-de24dfb785b2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:02.516966 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e72654-1ad6-4d52-971d-348fbc9ebd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:02.518045 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e72654-1ad6-4d52-971d-348fbc9ebd01 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:02.518576 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e72654-1ad6-4d52-971d-348fbc9ebd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:02.519065 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e72654-1ad6-4d52-971d-348fbc9ebd01 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:02.520044 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e72654-1ad6-4d52-971d-348fbc9ebd01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:02.520568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e72654-1ad6-4d52-971d-348fbc9ebd01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:02.522760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e72654-1ad6-4d52-971d-348fbc9ebd01 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:02.540298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 340/691] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:02.540491 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:02.542749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e72654-1ad6-4d52-971d-348fbc9ebd01 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:02.554752 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5b084-a4a0-4311-a5c9-73aa541b243c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:02.556667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5b084-a4a0-4311-a5c9-73aa541b243c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:02.557292 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5b084-a4a0-4311-a5c9-73aa541b243c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:02.557806 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5b084-a4a0-4311-a5c9-73aa541b243c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:02.572914 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5b084-a4a0-4311-a5c9-73aa541b243c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:02.574384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5b084-a4a0-4311-a5c9-73aa541b243c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:02.599259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c0a5b084-a4a0-4311-a5c9-73aa541b243c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:02.599259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:02.599259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:02.599259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:02.599259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:02.599259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:02.599259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:02.599259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:02.599259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:02.599259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:02.599259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:02.599259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:02.599259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:02.599259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:02.599259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:02.600774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:02.606804 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:02.606804 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:02.606804 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:02.606804 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:02.606804 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 352/692] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:02.611896 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5b084-a4a0-4311-a5c9-73aa541b243c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:02.700453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e72654-1ad6-4d52-971d-348fbc9ebd01 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:02.760031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9249f7-aabc-4692-9f63-25d030e7e59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:02.761265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5b084-a4a0-4311-a5c9-73aa541b243c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:02.761398 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9249f7-aabc-4692-9f63-25d030e7e59f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:02.761879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9249f7-aabc-4692-9f63-25d030e7e59f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:02.762370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9249f7-aabc-4692-9f63-25d030e7e59f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:02.783984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9249f7-aabc-4692-9f63-25d030e7e59f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:02.785888 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9249f7-aabc-4692-9f63-25d030e7e59f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:02.813835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480ec35-6418-468f-9fd4-131c9ccb41c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:02.814528 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480ec35-6418-468f-9fd4-131c9ccb41c6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:02.814816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480ec35-6418-468f-9fd4-131c9ccb41c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:02.815101 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480ec35-6418-468f-9fd4-131c9ccb41c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:02.815910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480ec35-6418-468f-9fd4-131c9ccb41c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:02.816220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480ec35-6418-468f-9fd4-131c9ccb41c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:02.817665 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480ec35-6418-468f-9fd4-131c9ccb41c6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-5e9249f7-aabc-4692-9f63-25d030e7e59f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:32:02.821527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:02.822474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:02.823444 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:02.823444 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:02.823444 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:32:02.823444 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:32:02.823444 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:32:02.823444 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:32:02.823444 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:32:02.823444 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:32:02.823444 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:32:02.823444 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:02.828436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 341/693] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Jun 15 09:32:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:02.834374 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9249f7-aabc-4692-9f63-25d030e7e59f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:02.839836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 353/694] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:02.845463 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480ec35-6418-468f-9fd4-131c9ccb41c6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:02.880844 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:02.923275 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:03.025940 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480ec35-6418-468f-9fd4-131c9ccb41c6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:03.066630 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c19b8f-adc8-45b8-878f-f3c1627c9101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:03.067485 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c19b8f-adc8-45b8-878f-f3c1627c9101 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:03.067771 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c19b8f-adc8-45b8-878f-f3c1627c9101 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:03.068044 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c19b8f-adc8-45b8-878f-f3c1627c9101 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:03.077351 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c19b8f-adc8-45b8-878f-f3c1627c9101 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:03.079230 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c19b8f-adc8-45b8-878f-f3c1627c9101 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:03.095798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-24c19b8f-adc8-45b8-878f-f3c1627c9101 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:03.095798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:03.095798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:03.095798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:03.095798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:03.095798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:03.095798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:03.095798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:03.095798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:03.095798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:03.095798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:03.095798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:03.095798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:03.095798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:03.095798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:03.096964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:03.098084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:03.098084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:03.098084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:03.098084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:03.098084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:03.098084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:03.098084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:03.098084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:03.099931 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9249f7-aabc-4692-9f63-25d030e7e59f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:03.100064 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 354/695] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:03.119000 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c19b8f-adc8-45b8-878f-f3c1627c9101 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:03.142070 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46fc89-0f04-4d2f-b4ed-532012e5ed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:03.142786 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46fc89-0f04-4d2f-b4ed-532012e5ed55 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:03.143070 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46fc89-0f04-4d2f-b4ed-532012e5ed55 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:03.143419 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46fc89-0f04-4d2f-b4ed-532012e5ed55 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:03.144266 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46fc89-0f04-4d2f-b4ed-532012e5ed55 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:03.144578 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46fc89-0f04-4d2f-b4ed-532012e5ed55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:03.146021 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46fc89-0f04-4d2f-b4ed-532012e5ed55 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:03.166535 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 342/696] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Jun 15 09:32:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:03.173384 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46fc89-0f04-4d2f-b4ed-532012e5ed55 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:03.314972 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:03.321531 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46fc89-0f04-4d2f-b4ed-532012e5ed55 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:03.347687 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:03.365492 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b5a16-a354-45ca-ae29-257fc520c041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:03.366439 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b5a16-a354-45ca-ae29-257fc520c041 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:03.367099 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b5a16-a354-45ca-ae29-257fc520c041 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:03.367622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b5a16-a354-45ca-ae29-257fc520c041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:03.368846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c19b8f-adc8-45b8-878f-f3c1627c9101 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:03.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b5a16-a354-45ca-ae29-257fc520c041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:03.473262 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b5a16-a354-45ca-ae29-257fc520c041 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:03.490626 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c5428-b53f-43f4-a9c4-4f454a32b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:03.491365 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c5428-b53f-43f4-a9c4-4f454a32b177 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:03.491655 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c5428-b53f-43f4-a9c4-4f454a32b177 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:03.491941 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c5428-b53f-43f4-a9c4-4f454a32b177 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:03.492754 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c5428-b53f-43f4-a9c4-4f454a32b177 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:03.493073 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c5428-b53f-43f4-a9c4-4f454a32b177 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:03.494567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c5428-b53f-43f4-a9c4-4f454a32b177 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:03.508071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 355/697] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:03.514009 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8109-8819-49da-9f36-46deecdb394a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:03.514009 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8109-8819-49da-9f36-46deecdb394a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:03.514009 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c8109-8819-49da-9f36-46deecdb394a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:03.515817 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 356/698] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:03.516750 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c8109-8819-49da-9f36-46deecdb394a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:03.585745 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:03.617229 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 343/699] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:32:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:32:03.619048 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b842b-f79c-4b5c-af78-0768791c8d28 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:03.619515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b842b-f79c-4b5c-af78-0768791c8d28 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:03.619960 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b842b-f79c-4b5c-af78-0768791c8d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:03.638481 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f49b842b-f79c-4b5c-af78-0768791c8d28 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:03.640234 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f49b842b-f79c-4b5c-af78-0768791c8d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:03.646880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c8109-8819-49da-9f36-46deecdb394a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:03.706144 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6a78f-6787-4197-aab7-a3dca56e08d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:03.708009 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6a78f-6787-4197-aab7-a3dca56e08d8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:03.708793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6a78f-6787-4197-aab7-a3dca56e08d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:03.709451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6a78f-6787-4197-aab7-a3dca56e08d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:03.711430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6a78f-6787-4197-aab7-a3dca56e08d8 None admin] RBAC: Adding query filter params (role.id=0ff0d3dcb5e448c3abc2470461490795, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=cdbfc031f967416e9a2c94bce3d28f66) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:03.712222 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6a78f-6787-4197-aab7-a3dca56e08d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:03.714777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6a78f-6787-4197-aab7-a3dca56e08d8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:03.726645 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 357/700] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:32:03 2022] GET /identity/v3/role_assignments?user.id=cdbfc031f967416e9a2c94bce3d28f66&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=0ff0d3dcb5e448c3abc2470461490795 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:03.728647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6a78f-6787-4197-aab7-a3dca56e08d8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:03.734554 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 344/701] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:32:03.734554 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f57193-16ca-47da-b42d-ba789699ee32 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:03.734554 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f57193-16ca-47da-b42d-ba789699ee32 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:03.734554 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f57193-16ca-47da-b42d-ba789699ee32 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:03.734554 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 345/702] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:03.747298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d40ec-80e7-4380-aca9-8c22298216ff None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:03.747795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d40ec-80e7-4380-aca9-8c22298216ff None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:03.748278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d40ec-80e7-4380-aca9-8c22298216ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:03.771105 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1f6d40ec-80e7-4380-aca9-8c22298216ff None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:03.773062 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1f6d40ec-80e7-4380-aca9-8c22298216ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:03.794608 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:03.889948 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 346/703] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:32:03.889948 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d40ec-80e7-4380-aca9-8c22298216ff None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:03.937862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6a78f-6787-4197-aab7-a3dca56e08d8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:03.958830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:03.984255 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd46bba-b3f7-4f39-bf91-8a964f3d90ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:03.985397 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd46bba-b3f7-4f39-bf91-8a964f3d90ee None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:03.985684 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd46bba-b3f7-4f39-bf91-8a964f3d90ee None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:03.985974 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd46bba-b3f7-4f39-bf91-8a964f3d90ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:04.004437 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd46bba-b3f7-4f39-bf91-8a964f3d90ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:04.009559 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd46bba-b3f7-4f39-bf91-8a964f3d90ee None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:04.033202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8cd46bba-b3f7-4f39-bf91-8a964f3d90ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:04.033202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:04.033202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:04.033202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:04.033202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:04.033202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:04.033202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:04.033202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:04.033202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:04.033202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:04.033202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:04.033202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:04.033202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:04.033202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:04.033202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:04.034756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:04.035655 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:04.035655 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:04.035655 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:04.035655 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:04.035655 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 358/704] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:04.035655 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd46bba-b3f7-4f39-bf91-8a964f3d90ee None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:04.090298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d40ec-80e7-4380-aca9-8c22298216ff None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:04.114819 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:04.134381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93bfea-485d-4357-94bc-c166ed64b5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:04.135714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93bfea-485d-4357-94bc-c166ed64b5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:04.136212 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93bfea-485d-4357-94bc-c166ed64b5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:04.136830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93bfea-485d-4357-94bc-c166ed64b5e0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:04.138084 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93bfea-485d-4357-94bc-c166ed64b5e0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:04.140278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93bfea-485d-4357-94bc-c166ed64b5e0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:04.150276 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd46bba-b3f7-4f39-bf91-8a964f3d90ee None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-4a93bfea-485d-4357-94bc-c166ed64b5e0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:04.157387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:04.158881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:04.159730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:04.159730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:04.159730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:04.159730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:04.159730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:04.159730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:04.159730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:04.159730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:04.159730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:04.159730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:04.159730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:04.159730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:04.159730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:04.159730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 09:32:04.159730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:04.163030 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 347/705] 10.222.0.45 () {56 vars in 1129 bytes} [Wed Jun 15 09:32:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:04.164254 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93bfea-485d-4357-94bc-c166ed64b5e0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:04.190469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88d431-6a66-48a9-9ef4-434dd959ce4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:04.191491 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88d431-6a66-48a9-9ef4-434dd959ce4c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:04.191853 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88d431-6a66-48a9-9ef4-434dd959ce4c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:04.192137 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88d431-6a66-48a9-9ef4-434dd959ce4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:04.211039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88d431-6a66-48a9-9ef4-434dd959ce4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:04.213844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88d431-6a66-48a9-9ef4-434dd959ce4c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:04.248340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-eb88d431-6a66-48a9-9ef4-434dd959ce4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:04.248340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:04.248340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:04.248340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:04.248340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:04.248340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:04.248340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:04.248340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:04.248340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:04.248340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:04.248340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:04.248340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:04.248340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:04.248340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:04.248340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:04.249393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:04.250348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:04.250348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:04.250348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:04.250348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:04.258624 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 359/706] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:04.260325 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88d431-6a66-48a9-9ef4-434dd959ce4c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:04.294736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93bfea-485d-4357-94bc-c166ed64b5e0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:04.297572 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:04.348355 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb162de-129e-4c74-a814-61e95729f839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:04.349942 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb162de-129e-4c74-a814-61e95729f839 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:04.351019 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb162de-129e-4c74-a814-61e95729f839 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:04.351617 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb162de-129e-4c74-a814-61e95729f839 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:04.352714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb162de-129e-4c74-a814-61e95729f839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:04.353376 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb162de-129e-4c74-a814-61e95729f839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:04.355024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb162de-129e-4c74-a814-61e95729f839 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:04.373420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 348/707] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:04.374851 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb162de-129e-4c74-a814-61e95729f839 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:04.410146 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88d431-6a66-48a9-9ef4-434dd959ce4c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:04.442063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:04.455033 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f13ea7-d63f-41e8-b32a-091871bbef18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:04.455715 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f13ea7-d63f-41e8-b32a-091871bbef18 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:04.456029 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f13ea7-d63f-41e8-b32a-091871bbef18 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:04.456336 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f13ea7-d63f-41e8-b32a-091871bbef18 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:04.457029 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f13ea7-d63f-41e8-b32a-091871bbef18 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:04.457278 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f13ea7-d63f-41e8-b32a-091871bbef18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:04.459803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f13ea7-d63f-41e8-b32a-091871bbef18 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:04.467496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 360/708] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Jun 15 09:32:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:04.468083 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f13ea7-d63f-41e8-b32a-091871bbef18 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:04.535663 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb162de-129e-4c74-a814-61e95729f839 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:04.584041 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51454ddd-fe7c-4a27-ae1e-e4f794b39d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:04.585179 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51454ddd-fe7c-4a27-ae1e-e4f794b39d42 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:04.585662 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51454ddd-fe7c-4a27-ae1e-e4f794b39d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:04.586136 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51454ddd-fe7c-4a27-ae1e-e4f794b39d42 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:04.587105 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51454ddd-fe7c-4a27-ae1e-e4f794b39d42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:04.587617 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51454ddd-fe7c-4a27-ae1e-e4f794b39d42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:04.589226 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51454ddd-fe7c-4a27-ae1e-e4f794b39d42 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:04.602757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 349/709] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:04.604047 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51454ddd-fe7c-4a27-ae1e-e4f794b39d42 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:04.613420 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f13ea7-d63f-41e8-b32a-091871bbef18 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:04.632506 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:04.653480 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4233375-d0b7-496b-92f9-c74ecce2188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:04.654518 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4233375-d0b7-496b-92f9-c74ecce2188b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:04.654702 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4233375-d0b7-496b-92f9-c74ecce2188b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:04.654931 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4233375-d0b7-496b-92f9-c74ecce2188b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:04.663373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4233375-d0b7-496b-92f9-c74ecce2188b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:04.664827 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4233375-d0b7-496b-92f9-c74ecce2188b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:04.680350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a4233375-d0b7-496b-92f9-c74ecce2188b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:04.680350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:04.680350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:04.680350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:04.680350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:04.680350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:04.680350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:04.680350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:04.680350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:04.680350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:04.680350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:04.680350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:04.680350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:04.680350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:04.680350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:04.681346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:04.682271 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:04.682271 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:04.682271 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:04.682271 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:04.682271 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:04.682271 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:04.682271 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:04.682271 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:04.682271 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 361/710] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:04.683262 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4233375-d0b7-496b-92f9-c74ecce2188b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:04.723595 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51454ddd-fe7c-4a27-ae1e-e4f794b39d42 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:04.740277 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:04.774398 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90054c-7355-4ac0-863b-57808525f742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:04.775379 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90054c-7355-4ac0-863b-57808525f742 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:04.775714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90054c-7355-4ac0-863b-57808525f742 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:04.776035 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90054c-7355-4ac0-863b-57808525f742 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:04.777117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90054c-7355-4ac0-863b-57808525f742 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:04.777498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90054c-7355-4ac0-863b-57808525f742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:04.779165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90054c-7355-4ac0-863b-57808525f742 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:04.789157 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 350/711] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Jun 15 09:32:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:04.790437 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90054c-7355-4ac0-863b-57808525f742 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:04.820591 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4233375-d0b7-496b-92f9-c74ecce2188b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:04.881773 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384043e-5995-4986-9093-aabd596d0849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:04.883465 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384043e-5995-4986-9093-aabd596d0849 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:04.884079 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384043e-5995-4986-9093-aabd596d0849 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:04.884713 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384043e-5995-4986-9093-aabd596d0849 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:04.886082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384043e-5995-4986-9093-aabd596d0849 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:04.888119 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384043e-5995-4986-9093-aabd596d0849 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:04.921881 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:04.927934 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 362/712] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:32:04 2022] POST /identity/v3/users => generated 254 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:32:04.943753 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90054c-7355-4ac0-863b-57808525f742 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:04.992182 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece2a56-bda1-4862-946b-812f06c7354a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:04.992935 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece2a56-bda1-4862-946b-812f06c7354a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:04.993227 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece2a56-bda1-4862-946b-812f06c7354a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:04.993511 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece2a56-bda1-4862-946b-812f06c7354a None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:04.994347 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece2a56-bda1-4862-946b-812f06c7354a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:04.994741 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece2a56-bda1-4862-946b-812f06c7354a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:04.996301 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece2a56-bda1-4862-946b-812f06c7354a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:05.013315 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 351/713] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:05.019822 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384043e-5995-4986-9093-aabd596d0849 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:05.172695 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88fcb3-b2ce-41fb-be33-4f7f1f65e064 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:05.172896 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88fcb3-b2ce-41fb-be33-4f7f1f65e064 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:05.173175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88fcb3-b2ce-41fb-be33-4f7f1f65e064 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:05.175612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 352/714] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:32:05.182421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca94ac-bb71-46c9-8890-36adf5832d90 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:05.182744 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca94ac-bb71-46c9-8890-36adf5832d90 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:05.183540 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca94ac-bb71-46c9-8890-36adf5832d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:05.204749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d6ca94ac-bb71-46c9-8890-36adf5832d90 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:05.206003 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d6ca94ac-bb71-46c9-8890-36adf5832d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:05.208110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384043e-5995-4986-9093-aabd596d0849 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:05.217071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:05.282680 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330c06a-cac4-4817-a79f-0c2007df47bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:05.283875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330c06a-cac4-4817-a79f-0c2007df47bd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:05.284377 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330c06a-cac4-4817-a79f-0c2007df47bd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:05.284877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330c06a-cac4-4817-a79f-0c2007df47bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:05.286566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330c06a-cac4-4817-a79f-0c2007df47bd None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=26dbaf7292444c8f9a6d45bfaf96763f) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:05.287206 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330c06a-cac4-4817-a79f-0c2007df47bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:05.290516 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330c06a-cac4-4817-a79f-0c2007df47bd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:05.301786 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 363/715] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:32:05 2022] GET /identity/v3/role_assignments?user.id=26dbaf7292444c8f9a6d45bfaf96763f&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:05.313403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 353/716] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:32:05.335969 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330c06a-cac4-4817-a79f-0c2007df47bd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:05.544693 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330c06a-cac4-4817-a79f-0c2007df47bd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:05.586937 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99decc1-c878-4a46-9e04-3350502f4f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:05.587761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99decc1-c878-4a46-9e04-3350502f4f8f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:05.588044 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99decc1-c878-4a46-9e04-3350502f4f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:05.588320 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99decc1-c878-4a46-9e04-3350502f4f8f None admin] PATH_INFO: `/v3/services/network` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:05.588974 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99decc1-c878-4a46-9e04-3350502f4f8f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:05.590363 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99decc1-c878-4a46-9e04-3350502f4f8f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d99decc1-c878-4a46-9e04-3350502f4f8f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:05.610378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:05.611458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:05.612288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:05.612288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:05.612288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:05.612288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:05.612288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:05.612288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:05.612288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:05.612288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:05.612288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:05.612288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:05.612288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:05.612288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:05.612288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 09:32:05.612288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:05.614031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 364/717] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:05 2022] GET /identity/v3/services/network => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:05.620099 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca94ac-bb71-46c9-8890-36adf5832d90 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:05.797179 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:05.836379 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca94ac-bb71-46c9-8890-36adf5832d90 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:05.896582 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c195c8b-319e-41e5-ab93-1e49ba62611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:05.897340 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c195c8b-319e-41e5-ab93-1e49ba62611a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:05.897631 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c195c8b-319e-41e5-ab93-1e49ba62611a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:05.897916 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c195c8b-319e-41e5-ab93-1e49ba62611a None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:05.898676 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c195c8b-319e-41e5-ab93-1e49ba62611a None admin] RBAC: Adding query filter params (name=network) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:05.898995 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c195c8b-319e-41e5-ab93-1e49ba62611a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:05.900416 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c195c8b-319e-41e5-ab93-1e49ba62611a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:05.911031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 354/718] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Jun 15 09:32:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:05.917145 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99decc1-c878-4a46-9e04-3350502f4f8f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:05.993829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:06.109036 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99decc1-c878-4a46-9e04-3350502f4f8f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:06.178016 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e67c99-785e-440b-95e9-f851355a4aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:06.179325 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e67c99-785e-440b-95e9-f851355a4aab None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:06.179805 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e67c99-785e-440b-95e9-f851355a4aab None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:06.180321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e67c99-785e-440b-95e9-f851355a4aab None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:06.181797 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e67c99-785e-440b-95e9-f851355a4aab None admin] RBAC: Adding query filter params (type=network) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:06.182373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e67c99-785e-440b-95e9-f851355a4aab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:06.185384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e67c99-785e-440b-95e9-f851355a4aab None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:06.197723 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 365/719] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Jun 15 09:32:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:06.464811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe2576-d7d5-4b42-8fd2-9394021f4994 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:06.465514 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe2576-d7d5-4b42-8fd2-9394021f4994 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:06.466012 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe2576-d7d5-4b42-8fd2-9394021f4994 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:06.467791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 355/720] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:06.484762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ed010-5b8e-4ff3-8972-5e85030ecedd None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:06.485293 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ed010-5b8e-4ff3-8972-5e85030ecedd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:06.485370 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ed010-5b8e-4ff3-8972-5e85030ecedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:06.511058 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fd7ed010-5b8e-4ff3-8972-5e85030ecedd None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:06.512356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fd7ed010-5b8e-4ff3-8972-5e85030ecedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:06.630806 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 366/721] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:32:06.656757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe2576-d7d5-4b42-8fd2-9394021f4994 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:06.784220 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe2576-d7d5-4b42-8fd2-9394021f4994 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:06.822223 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57033-759c-459e-ba3e-edc6bebdf5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:06.823559 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57033-759c-459e-ba3e-edc6bebdf5cc None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:06.824060 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57033-759c-459e-ba3e-edc6bebdf5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:06.824542 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d57033-759c-459e-ba3e-edc6bebdf5cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:06.833895 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:06.837739 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d57033-759c-459e-ba3e-edc6bebdf5cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-e3d57033-759c-459e-ba3e-edc6bebdf5cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:32:06.846308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:06.848166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:06.849811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:06.849811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:06.849811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:06.849811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:06.849811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:32:06.849811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:32:06.849811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:32:06.849811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:32:06.849811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:32:06.849811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:32:06.849811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:32:06.849811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:06.853392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 356/722] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:32:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:06.859555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ed010-5b8e-4ff3-8972-5e85030ecedd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:06.908407 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:07.129266 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ed010-5b8e-4ff3-8972-5e85030ecedd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:07.227369 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ce104-4aef-4852-853d-10bebe5c8f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:07.228094 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ce104-4aef-4852-853d-10bebe5c8f30 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:07.228382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ce104-4aef-4852-853d-10bebe5c8f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:07.228664 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ce104-4aef-4852-853d-10bebe5c8f30 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:07.229461 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ce104-4aef-4852-853d-10bebe5c8f30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:07.229775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ce104-4aef-4852-853d-10bebe5c8f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:07.231288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ce104-4aef-4852-853d-10bebe5c8f30 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:07.242377 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 367/723] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:32:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:07.251781 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57033-759c-459e-ba3e-edc6bebdf5cc None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:07.582184 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d57033-759c-459e-ba3e-edc6bebdf5cc None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:07.715719 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fc2bf-d71a-4944-b5ed-e66467431dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:07.717099 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fc2bf-d71a-4944-b5ed-e66467431dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:07.717399 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fc2bf-d71a-4944-b5ed-e66467431dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:07.717803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fc2bf-d71a-4944-b5ed-e66467431dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:07.740168 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962efa3-3c96-468b-82a4-d426e4ef603b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:07.740769 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962efa3-3c96-468b-82a4-d426e4ef603b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:07.740769 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962efa3-3c96-468b-82a4-d426e4ef603b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:07.742482 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 368/724] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:07.748808 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4224a8-7027-477f-98b7-14a27b3a9925 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:07.748808 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4224a8-7027-477f-98b7-14a27b3a9925 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:07.748808 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4224a8-7027-477f-98b7-14a27b3a9925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:07.754520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fc2bf-d71a-4944-b5ed-e66467431dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:07.754520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fc2bf-d71a-4944-b5ed-e66467431dc3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:07.810604 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9b4224a8-7027-477f-98b7-14a27b3a9925 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:07.812188 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9b4224a8-7027-477f-98b7-14a27b3a9925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:07.830627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-411fc2bf-d71a-4944-b5ed-e66467431dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:07.830627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:07.830627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:07.830627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:07.830627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:07.830627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:07.830627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:07.830627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:07.830627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:07.830627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:07.830627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:07.830627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:07.830627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:07.830627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:07.830627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:07.831670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:07.832593 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:07.832593 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:07.832593 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:07.832593 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:07.833402 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 357/725] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 582 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:07.840369 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fc2bf-d71a-4944-b5ed-e66467431dc3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:07.935535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 369/726] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:32:07.955612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:07.956260 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4224a8-7027-477f-98b7-14a27b3a9925 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:07.978519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:08.077654 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4224a8-7027-477f-98b7-14a27b3a9925 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:08.079967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fc2bf-d71a-4944-b5ed-e66467431dc3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:08.126349 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be123827-62ae-454f-abb6-67c9b370811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:08.127416 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be123827-62ae-454f-abb6-67c9b370811c None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:08.127857 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be123827-62ae-454f-abb6-67c9b370811c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:08.128315 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be123827-62ae-454f-abb6-67c9b370811c None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:08.129304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be123827-62ae-454f-abb6-67c9b370811c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:08.130907 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be123827-62ae-454f-abb6-67c9b370811c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:08.169161 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 370/727] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Jun 15 09:32:07 2022] POST /identity/v3/services => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 09:32:08.187626 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7f079-1207-48a0-9297-f5dbc01f0cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:08.188648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7f079-1207-48a0-9297-f5dbc01f0cff None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:08.189129 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7f079-1207-48a0-9297-f5dbc01f0cff None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:08.189615 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7f079-1207-48a0-9297-f5dbc01f0cff None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:08.190762 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7f079-1207-48a0-9297-f5dbc01f0cff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:08.191228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7f079-1207-48a0-9297-f5dbc01f0cff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:08.192890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7f079-1207-48a0-9297-f5dbc01f0cff None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:08.208195 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 358/728] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:08.215498 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be123827-62ae-454f-abb6-67c9b370811c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:08.346489 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:08.374934 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be123827-62ae-454f-abb6-67c9b370811c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:08.433847 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c02aa5-c362-486d-8f1e-28cc7761dbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:08.434710 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c02aa5-c362-486d-8f1e-28cc7761dbdd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:08.435001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c02aa5-c362-486d-8f1e-28cc7761dbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:08.435294 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c02aa5-c362-486d-8f1e-28cc7761dbdd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:08.445672 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c02aa5-c362-486d-8f1e-28cc7761dbdd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:08.447364 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c02aa5-c362-486d-8f1e-28cc7761dbdd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:08.469225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dd2f9-6202-4d0e-8fe2-5eefe7b2df5f None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:08.469225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dd2f9-6202-4d0e-8fe2-5eefe7b2df5f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:08.469225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dd2f9-6202-4d0e-8fe2-5eefe7b2df5f None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a4c02aa5-c362-486d-8f1e-28cc7761dbdd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:32:08.471613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:08.472593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:08.473535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:08.473535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:08.473535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:32:08.473535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:32:08.473535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:32:08.473535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:32:08.473535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:32:08.473535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:32:08.473535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 09:32:08.473535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:08.474083 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 359/729] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:08.474156 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 371/730] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:32:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:08.478721 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dd2f9-6202-4d0e-8fe2-5eefe7b2df5f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:08.482229 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39d008-215d-42bf-a6c4-4557e17a8bde None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:08.482539 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39d008-215d-42bf-a6c4-4557e17a8bde None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:08.482833 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39d008-215d-42bf-a6c4-4557e17a8bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:08.502670 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0a39d008-215d-42bf-a6c4-4557e17a8bde None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:08.503973 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0a39d008-215d-42bf-a6c4-4557e17a8bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:08.632761 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dd2f9-6202-4d0e-8fe2-5eefe7b2df5f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:08.644010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:08.653091 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 372/731] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 09:32:08.673349 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f65c2f-21d3-476c-81b4-6db2ce966194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:08.674038 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f65c2f-21d3-476c-81b4-6db2ce966194 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:08.674329 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f65c2f-21d3-476c-81b4-6db2ce966194 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:08.674643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f65c2f-21d3-476c-81b4-6db2ce966194 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:08.675499 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f65c2f-21d3-476c-81b4-6db2ce966194 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:08.675818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f65c2f-21d3-476c-81b4-6db2ce966194 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:08.677300 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f65c2f-21d3-476c-81b4-6db2ce966194 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:08.698924 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 360/732] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Jun 15 09:32:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:08.699927 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39d008-215d-42bf-a6c4-4557e17a8bde None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:08.706530 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f65c2f-21d3-476c-81b4-6db2ce966194 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:08.834961 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:08.885529 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39d008-215d-42bf-a6c4-4557e17a8bde None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:08.905182 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f65c2f-21d3-476c-81b4-6db2ce966194 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:08.930068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb78372-35d4-43de-87f0-9811fa989e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:08.930936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb78372-35d4-43de-87f0-9811fa989e8d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:08.931227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb78372-35d4-43de-87f0-9811fa989e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:08.931511 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb78372-35d4-43de-87f0-9811fa989e8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:08.944811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb78372-35d4-43de-87f0-9811fa989e8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9cb78372-35d4-43de-87f0-9811fa989e8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:32:08.952995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:08.954068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:08.955427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:08.955427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:08.955427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:08.955427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:08.955427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:32:08.955427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:32:08.955427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:32:08.955427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:32:08.955427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:32:08.955427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:32:08.955427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:32:08.955427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:08.955427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 373/733] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:32:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:08.956431 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57c0f6-52da-4a08-a839-cd9e130e3bd7 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:08.956431 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57c0f6-52da-4a08-a839-cd9e130e3bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:08.956721 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57c0f6-52da-4a08-a839-cd9e130e3bd7 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:08.959594 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c032e-55b5-4ee9-aafb-ad064c766cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:08.960703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c032e-55b5-4ee9-aafb-ad064c766cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:08.961192 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c032e-55b5-4ee9-aafb-ad064c766cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:08.961684 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c032e-55b5-4ee9-aafb-ad064c766cc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:08.963241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 374/734] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:08.964262 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57c0f6-52da-4a08-a839-cd9e130e3bd7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:09.008035 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:09.052149 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c032e-55b5-4ee9-aafb-ad064c766cc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:09.054366 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c032e-55b5-4ee9-aafb-ad064c766cc9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:09.127008 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57c0f6-52da-4a08-a839-cd9e130e3bd7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:09.171923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:09.187072 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 361/735] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:32:08 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 09:32:09.187072 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be28157-818e-4bae-8d1f-c131b0ed2fd0 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:09.187072 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be28157-818e-4bae-8d1f-c131b0ed2fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:09.187072 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be28157-818e-4bae-8d1f-c131b0ed2fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:09.190193 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb3840-bf23-4633-9892-69cc8292570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:09.191101 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb3840-bf23-4633-9892-69cc8292570b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:09.191907 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb3840-bf23-4633-9892-69cc8292570b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:09.192340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb3840-bf23-4633-9892-69cc8292570b None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:09.194376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb3840-bf23-4633-9892-69cc8292570b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:09.194884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb3840-bf23-4633-9892-69cc8292570b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:09.196446 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb3840-bf23-4633-9892-69cc8292570b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:09.205278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0be28157-818e-4bae-8d1f-c131b0ed2fd0 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:09.206800 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0be28157-818e-4bae-8d1f-c131b0ed2fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:09.209778 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 375/736] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:32:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:09.212011 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb3840-bf23-4633-9892-69cc8292570b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:09.323500 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:09.347896 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 362/737] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:32:09.350842 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be28157-818e-4bae-8d1f-c131b0ed2fd0 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:09.393707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb3840-bf23-4633-9892-69cc8292570b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:09.435560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c8fce-f9a0-449d-9189-5d4953fd2946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:09.436282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c8fce-f9a0-449d-9189-5d4953fd2946 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:09.436561 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c8fce-f9a0-449d-9189-5d4953fd2946 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:09.436840 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c8fce-f9a0-449d-9189-5d4953fd2946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:09.450317 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c8fce-f9a0-449d-9189-5d4953fd2946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:09.452351 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c8fce-f9a0-449d-9189-5d4953fd2946 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:09.473215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-101c8fce-f9a0-449d-9189-5d4953fd2946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:09.473215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:09.473215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:09.473215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:09.473215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:09.473215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:09.473215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:09.473215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:09.473215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:09.473215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:09.473215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:09.473215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:09.473215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:09.473215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:09.473215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:09.475999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:09.477761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:09.477761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:09.477761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:09.477761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:09.477761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 376/738] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:09.477761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c8fce-f9a0-449d-9189-5d4953fd2946 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:09.533152 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:09.586377 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be28157-818e-4bae-8d1f-c131b0ed2fd0 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:09.610523 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c8fce-f9a0-449d-9189-5d4953fd2946 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:09.651168 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a507ae0-0b24-4412-99ad-fdb7f15c92b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:09.652203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a507ae0-0b24-4412-99ad-fdb7f15c92b8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:09.652503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a507ae0-0b24-4412-99ad-fdb7f15c92b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:09.652788 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a507ae0-0b24-4412-99ad-fdb7f15c92b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:09.662325 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4348d-06bb-4d42-9e51-681232989973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:09.664082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4348d-06bb-4d42-9e51-681232989973 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:09.664705 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4348d-06bb-4d42-9e51-681232989973 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:09.665337 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4348d-06bb-4d42-9e51-681232989973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:09.665889 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a507ae0-0b24-4412-99ad-fdb7f15c92b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7a507ae0-0b24-4412-99ad-fdb7f15c92b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:32:09.674027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:09.675125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:09.675963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:09.675963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:09.675963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:09.675963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:09.675963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:32:09.675963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:32:09.675963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:32:09.675963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:32:09.675963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:32:09.675963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:32:09.675963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:32:09.675963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:09.680617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 377/739] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:32:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:09.681460 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a507ae0-0b24-4412-99ad-fdb7f15c92b8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:09.688077 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4348d-06bb-4d42-9e51-681232989973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:09.690889 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4348d-06bb-4d42-9e51-681232989973 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:09.729754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-2af4348d-06bb-4d42-9e51-681232989973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:09.729754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:09.729754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:09.729754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:09.729754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:09.729754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:09.729754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:09.729754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:09.729754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:09.729754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:09.729754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:09.729754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:09.729754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:09.729754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:09.729754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:09.731749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:09.733659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:09.733659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:09.733659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:09.733659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:09.742198 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 363/740] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:09.744217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4348d-06bb-4d42-9e51-681232989973 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:09.806127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a507ae0-0b24-4412-99ad-fdb7f15c92b8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:09.808165 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:09.852109 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:09.855122 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857394ad-ecdc-4e1c-9b3c-7884ce12d571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:09.855937 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857394ad-ecdc-4e1c-9b3c-7884ce12d571 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:09.857634 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857394ad-ecdc-4e1c-9b3c-7884ce12d571 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:09.858038 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857394ad-ecdc-4e1c-9b3c-7884ce12d571 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:09.859444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857394ad-ecdc-4e1c-9b3c-7884ce12d571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:09.859865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857394ad-ecdc-4e1c-9b3c-7884ce12d571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:09.862404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857394ad-ecdc-4e1c-9b3c-7884ce12d571 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:09.883015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 378/741] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:09.884066 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857394ad-ecdc-4e1c-9b3c-7884ce12d571 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:09.921892 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4348d-06bb-4d42-9e51-681232989973 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:09.974657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b46fd4-e96f-4454-b267-7ed4791d0f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:09.975663 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b46fd4-e96f-4454-b267-7ed4791d0f8b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:09.975981 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b46fd4-e96f-4454-b267-7ed4791d0f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:09.976446 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b46fd4-e96f-4454-b267-7ed4791d0f8b None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:09.977784 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b46fd4-e96f-4454-b267-7ed4791d0f8b None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:09.978270 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b46fd4-e96f-4454-b267-7ed4791d0f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:09.980664 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b46fd4-e96f-4454-b267-7ed4791d0f8b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:10.000073 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 364/742] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:32:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:10.000073 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b46fd4-e96f-4454-b267-7ed4791d0f8b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:10.057828 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857394ad-ecdc-4e1c-9b3c-7884ce12d571 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:10.108383 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b02b7-919d-42be-8ccc-5d67fd5b5253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:10.109802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b02b7-919d-42be-8ccc-5d67fd5b5253 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:10.110490 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b02b7-919d-42be-8ccc-5d67fd5b5253 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:10.110768 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b02b7-919d-42be-8ccc-5d67fd5b5253 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:10.112132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b02b7-919d-42be-8ccc-5d67fd5b5253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:10.112662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b02b7-919d-42be-8ccc-5d67fd5b5253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:10.115713 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b02b7-919d-42be-8ccc-5d67fd5b5253 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:10.142933 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 379/743] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:10.142933 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e1021-a5e0-4025-afe9-dd2cb1491acd None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:10.142933 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e1021-a5e0-4025-afe9-dd2cb1491acd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:10.142933 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e1021-a5e0-4025-afe9-dd2cb1491acd None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:10.145622 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 380/744] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:10.145785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e1021-a5e0-4025-afe9-dd2cb1491acd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:10.174274 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b46fd4-e96f-4454-b267-7ed4791d0f8b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:10.188542 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:10.195819 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:10.222267 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d74db-ef01-4f48-a6d7-feeedb39c7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:10.223397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d74db-ef01-4f48-a6d7-feeedb39c7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:10.223812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d74db-ef01-4f48-a6d7-feeedb39c7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:10.224220 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d74db-ef01-4f48-a6d7-feeedb39c7f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:10.233358 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d74db-ef01-4f48-a6d7-feeedb39c7f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:10.235037 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d74db-ef01-4f48-a6d7-feeedb39c7f2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:10.253317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7f2d74db-ef01-4f48-a6d7-feeedb39c7f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:10.253317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:10.253317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:10.253317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:10.253317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:10.253317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:10.253317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:10.253317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:10.253317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:10.253317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:10.253317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:10.253317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:10.253317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:10.253317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:10.253317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:10.255495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:10.264749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:10.264749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:10.264749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:10.264749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:10.264749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:10.264749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:10.264749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:10.264749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:10.264749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 365/745] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:10.264749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d74db-ef01-4f48-a6d7-feeedb39c7f2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:10.358620 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e1021-a5e0-4025-afe9-dd2cb1491acd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:10.416959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af075f0-d5f6-4c86-b7c0-d0c29bad7143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:10.418336 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af075f0-d5f6-4c86-b7c0-d0c29bad7143 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:10.418864 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af075f0-d5f6-4c86-b7c0-d0c29bad7143 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:10.419625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af075f0-d5f6-4c86-b7c0-d0c29bad7143 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:10.435062 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d74db-ef01-4f48-a6d7-feeedb39c7f2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:10.439870 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af075f0-d5f6-4c86-b7c0-d0c29bad7143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:10.441705 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af075f0-d5f6-4c86-b7c0-d0c29bad7143 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:10.476272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7af075f0-d5f6-4c86-b7c0-d0c29bad7143 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:10.476272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:10.476272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:10.476272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:10.476272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:10.476272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:10.476272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:10.476272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:10.476272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:10.476272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:10.476272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:10.476272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:10.476272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:10.476272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:10.476272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:10.477444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:10.478673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:10.478673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:10.478673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:10.478673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:10.484288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 381/746] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:10.486448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e773042-0302-4107-81dd-e6a210eed458 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:10.486855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e773042-0302-4107-81dd-e6a210eed458 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:10.487106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e773042-0302-4107-81dd-e6a210eed458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:10.503117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d7e0f-d23b-4875-ad74-ebfa360ce7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:10.504512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d7e0f-d23b-4875-ad74-ebfa360ce7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:10.505042 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d7e0f-d23b-4875-ad74-ebfa360ce7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:10.505550 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d7e0f-d23b-4875-ad74-ebfa360ce7b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:10.506405 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8e773042-0302-4107-81dd-e6a210eed458 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:10.507706 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8e773042-0302-4107-81dd-e6a210eed458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:10.522121 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d7e0f-d23b-4875-ad74-ebfa360ce7b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:10.524816 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d7e0f-d23b-4875-ad74-ebfa360ce7b0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-081d7e0f-d23b-4875-ad74-ebfa360ce7b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:32:10.554880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:10.555897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:10.556870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:10.556870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:10.556870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:32:10.556870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:32:10.556870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:32:10.556870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:32:10.556870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:32:10.556870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:32:10.556870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:32:10.556870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:10.557455 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 366/747] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Jun 15 09:32:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:10.558673 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d7e0f-d23b-4875-ad74-ebfa360ce7b0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:10.616843 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:10.642577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 382/748] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 09:32:10.642577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e773042-0302-4107-81dd-e6a210eed458 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:10.669861 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:10.738625 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d7e0f-d23b-4875-ad74-ebfa360ce7b0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:10.783429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77755e86-f4d7-48fa-ba87-9e358e1a7f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:10.784293 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77755e86-f4d7-48fa-ba87-9e358e1a7f6f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:10.784778 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77755e86-f4d7-48fa-ba87-9e358e1a7f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:10.785195 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77755e86-f4d7-48fa-ba87-9e358e1a7f6f None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:10.786158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77755e86-f4d7-48fa-ba87-9e358e1a7f6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:10.786644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77755e86-f4d7-48fa-ba87-9e358e1a7f6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:10.789430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77755e86-f4d7-48fa-ba87-9e358e1a7f6f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:10.804362 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 367/749] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:10.806451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77755e86-f4d7-48fa-ba87-9e358e1a7f6f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:10.863395 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e773042-0302-4107-81dd-e6a210eed458 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:10.930329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f043-69ec-4da6-9c56-e383bef3b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:10.931032 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:10.931538 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f043-69ec-4da6-9c56-e383bef3b45b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:10.932063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f043-69ec-4da6-9c56-e383bef3b45b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:10.932625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f043-69ec-4da6-9c56-e383bef3b45b None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:10.933980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139f043-69ec-4da6-9c56-e383bef3b45b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:10.934577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139f043-69ec-4da6-9c56-e383bef3b45b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:10.937254 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139f043-69ec-4da6-9c56-e383bef3b45b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:10.941251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77755e86-f4d7-48fa-ba87-9e358e1a7f6f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:10.959455 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 383/750] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:10.960946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f043-69ec-4da6-9c56-e383bef3b45b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:10.986656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215213a3-e5fe-4358-957d-c3035c791094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:10.987345 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215213a3-e5fe-4358-957d-c3035c791094 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:10.987635 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215213a3-e5fe-4358-957d-c3035c791094 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:10.987921 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215213a3-e5fe-4358-957d-c3035c791094 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:10.988839 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215213a3-e5fe-4358-957d-c3035c791094 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:10.989095 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215213a3-e5fe-4358-957d-c3035c791094 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:10.990580 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215213a3-e5fe-4358-957d-c3035c791094 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:11.017152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 368/751] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Jun 15 09:32:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:11.017152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215213a3-e5fe-4358-957d-c3035c791094 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:11.048443 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:11.091893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f043-69ec-4da6-9c56-e383bef3b45b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:11.129730 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617ed31-e4a1-4387-af7b-162f859d3ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:11.131227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617ed31-e4a1-4387-af7b-162f859d3ae3 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:11.131694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617ed31-e4a1-4387-af7b-162f859d3ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:11.132131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617ed31-e4a1-4387-af7b-162f859d3ae3 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:11.133332 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617ed31-e4a1-4387-af7b-162f859d3ae3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:11.135758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617ed31-e4a1-4387-af7b-162f859d3ae3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:11.157824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 384/752] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Jun 15 09:32:10 2022] POST /identity/v3/services => generated 240 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:32:11.159221 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2456d0a-c979-4f8d-b68b-53e3dc682f6b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:11.159512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2456d0a-c979-4f8d-b68b-53e3dc682f6b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:11.159799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2456d0a-c979-4f8d-b68b-53e3dc682f6b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:11.161147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 385/753] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:11.163812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215213a3-e5fe-4358-957d-c3035c791094 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:11.166398 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2456d0a-c979-4f8d-b68b-53e3dc682f6b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:11.221196 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f18e34-aceb-437b-aee9-6167890d4630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:11.222298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f18e34-aceb-437b-aee9-6167890d4630 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:11.222750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f18e34-aceb-437b-aee9-6167890d4630 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:11.223201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f18e34-aceb-437b-aee9-6167890d4630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:11.224528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f18e34-aceb-437b-aee9-6167890d4630 None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=cdbfc031f967416e9a2c94bce3d28f66) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:11.225011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f18e34-aceb-437b-aee9-6167890d4630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:11.227685 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f18e34-aceb-437b-aee9-6167890d4630 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:11.245029 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 369/754] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:32:11 2022] GET /identity/v3/role_assignments?user.id=cdbfc031f967416e9a2c94bce3d28f66&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:11.246324 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f18e34-aceb-437b-aee9-6167890d4630 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:11.264548 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:11.356504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2456d0a-c979-4f8d-b68b-53e3dc682f6b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:11.400815 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f18e34-aceb-437b-aee9-6167890d4630 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:11.405678 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:11.434711 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719798b-552f-4535-879b-aff529810e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:11.436121 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719798b-552f-4535-879b-aff529810e6e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:11.436913 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719798b-552f-4535-879b-aff529810e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:11.437164 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719798b-552f-4535-879b-aff529810e6e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:11.453013 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5829a1c-b356-4f25-a2d1-6d92834bc280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:11.453833 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719798b-552f-4535-879b-aff529810e6e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:11.453992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5829a1c-b356-4f25-a2d1-6d92834bc280 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:11.454120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5829a1c-b356-4f25-a2d1-6d92834bc280 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:11.454394 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5829a1c-b356-4f25-a2d1-6d92834bc280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:11.456787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719798b-552f-4535-879b-aff529810e6e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:11.470485 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5829a1c-b356-4f25-a2d1-6d92834bc280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:11.472121 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5829a1c-b356-4f25-a2d1-6d92834bc280 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8719798b-552f-4535-879b-aff529810e6e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:32:11.488348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:11.490932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:11.492675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:11.492675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:11.492675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:32:11.492675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:32:11.492675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:32:11.492675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:32:11.492675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:32:11.492675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:32:11.492675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 09:32:11.492675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:11.492675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 386/755] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Jun 15 09:32:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:11.494625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbddca6-98b6-458f-a976-86277b3e0ffc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:11.494625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbddca6-98b6-458f-a976-86277b3e0ffc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:11.495167 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbddca6-98b6-458f-a976-86277b3e0ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:11.498992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f5829a1c-b356-4f25-a2d1-6d92834bc280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:11.498992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:11.498992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:11.498992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:11.498992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:11.498992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:11.498992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:11.498992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:11.498992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:11.498992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:11.498992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:11.498992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:11.498992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:11.498992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:11.498992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:11.500947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:11.502801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:11.502801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:11.502801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:11.502801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:11.502801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 370/756] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:11.504483 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5829a1c-b356-4f25-a2d1-6d92834bc280 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:11.535781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5dbddca6-98b6-458f-a976-86277b3e0ffc None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:11.537899 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5dbddca6-98b6-458f-a976-86277b3e0ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:11.606239 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:11.666523 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 387/757] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:11.666523 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbddca6-98b6-458f-a976-86277b3e0ffc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:11.694909 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5829a1c-b356-4f25-a2d1-6d92834bc280 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:11.739507 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994dc42-e2ec-4aa0-be83-4db0845dfb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:11.741034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994dc42-e2ec-4aa0-be83-4db0845dfb0d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:11.741499 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994dc42-e2ec-4aa0-be83-4db0845dfb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:11.741933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994dc42-e2ec-4aa0-be83-4db0845dfb0d None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:11.743009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994dc42-e2ec-4aa0-be83-4db0845dfb0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:11.743499 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994dc42-e2ec-4aa0-be83-4db0845dfb0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:11.745126 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994dc42-e2ec-4aa0-be83-4db0845dfb0d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:11.773385 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 371/758] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Jun 15 09:32:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:11.774646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994dc42-e2ec-4aa0-be83-4db0845dfb0d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:11.873580 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbddca6-98b6-458f-a976-86277b3e0ffc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:11.890486 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994dc42-e2ec-4aa0-be83-4db0845dfb0d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:11.904292 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:11.913565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:11.940771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412eb9d0-6d6f-47c5-bfb0-771ddd046fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:11.942138 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eb9d0-6d6f-47c5-bfb0-771ddd046fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:11.942668 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eb9d0-6d6f-47c5-bfb0-771ddd046fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:11.943219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eb9d0-6d6f-47c5-bfb0-771ddd046fc1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:11.943999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412eb9d0-6d6f-47c5-bfb0-771ddd046fc1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:11.945678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412eb9d0-6d6f-47c5-bfb0-771ddd046fc1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:11.949757 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97777-1200-4049-937f-4ffcf58d1f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:11.951123 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97777-1200-4049-937f-4ffcf58d1f1e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:11.951736 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97777-1200-4049-937f-4ffcf58d1f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:11.952447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97777-1200-4049-937f-4ffcf58d1f1e None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:11.953922 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa97777-1200-4049-937f-4ffcf58d1f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:11.954617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa97777-1200-4049-937f-4ffcf58d1f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:11.957225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa97777-1200-4049-937f-4ffcf58d1f1e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-412eb9d0-6d6f-47c5-bfb0-771ddd046fc1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:11.959155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:11.960100 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:11.960952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:11.960952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:11.960952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:11.960952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:11.960952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:11.960952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:11.960952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:11.960952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:11.960952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:11.960952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:11.960952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:11.960952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:11.960952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:11.960952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 09:32:11.960952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:11.961761 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 372/759] 10.222.0.45 () {56 vars in 1129 bytes} [Wed Jun 15 09:32:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:11.961830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412eb9d0-6d6f-47c5-bfb0-771ddd046fc1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:11.981297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 388/760] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:11.983002 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97777-1200-4049-937f-4ffcf58d1f1e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:12.087001 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412eb9d0-6d6f-47c5-bfb0-771ddd046fc1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:12.148463 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97777-1200-4049-937f-4ffcf58d1f1e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:12.154037 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dd982-fad4-4132-9d4a-8f1f16be31bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:12.155376 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dd982-fad4-4132-9d4a-8f1f16be31bf None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:12.156138 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dd982-fad4-4132-9d4a-8f1f16be31bf None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:12.156820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dd982-fad4-4132-9d4a-8f1f16be31bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:12.190384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3155eb-2476-4643-8623-8a8fc8fceb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:12.191128 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3155eb-2476-4643-8623-8a8fc8fceb7b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:12.191705 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3155eb-2476-4643-8623-8a8fc8fceb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:12.191991 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3155eb-2476-4643-8623-8a8fc8fceb7b None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:12.192718 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3155eb-2476-4643-8623-8a8fc8fceb7b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:12.193055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3155eb-2476-4643-8623-8a8fc8fceb7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:12.194960 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3155eb-2476-4643-8623-8a8fc8fceb7b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:12.201127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 389/761] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Jun 15 09:32:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:12.202061 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3155eb-2476-4643-8623-8a8fc8fceb7b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:12.253197 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:12.257447 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:12.293889 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dd982-fad4-4132-9d4a-8f1f16be31bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:12.297160 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dd982-fad4-4132-9d4a-8f1f16be31bf None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:12.337340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3155eb-2476-4643-8623-8a8fc8fceb7b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:12.381282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eabfa-bb3c-408a-a77d-9cdfe7308249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:12.382716 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eabfa-bb3c-408a-a77d-9cdfe7308249 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:12.383214 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eabfa-bb3c-408a-a77d-9cdfe7308249 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:12.383667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eabfa-bb3c-408a-a77d-9cdfe7308249 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:12.398652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eabfa-bb3c-408a-a77d-9cdfe7308249 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:12.401133 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eabfa-bb3c-408a-a77d-9cdfe7308249 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:12.429360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ba2eabfa-bb3c-408a-a77d-9cdfe7308249 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:12.429360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:12.429360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:12.429360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:12.429360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:12.429360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:12.429360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:12.429360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:12.429360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:12.429360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:12.429360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:12.429360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:12.429360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:12.429360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:12.429360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:12.430323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:12.431227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:12.431227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:12.431227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:12.431227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:12.431227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:12.431227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:12.431227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:12.431227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:12.431657 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 390/762] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:12.432928 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eabfa-bb3c-408a-a77d-9cdfe7308249 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:12.462181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 373/763] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:32:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:32:12.463737 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dd982-fad4-4132-9d4a-8f1f16be31bf None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:12.581336 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:12.605573 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:12.612534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dd982-fad4-4132-9d4a-8f1f16be31bf None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:12.615364 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eabfa-bb3c-408a-a77d-9cdfe7308249 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:12.657035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc36ec-6a68-4791-8751-b841f75556ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:12.658357 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc36ec-6a68-4791-8751-b841f75556ec None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:12.659068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc36ec-6a68-4791-8751-b841f75556ec None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:12.659577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc36ec-6a68-4791-8751-b841f75556ec None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:12.660915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc36ec-6a68-4791-8751-b841f75556ec None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:12.661468 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc36ec-6a68-4791-8751-b841f75556ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:12.664209 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc36ec-6a68-4791-8751-b841f75556ec None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:12.665706 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ac4f9-285d-4d27-8ac4-2dc5655fe275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:12.666873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ac4f9-285d-4d27-8ac4-2dc5655fe275 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:12.667605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ac4f9-285d-4d27-8ac4-2dc5655fe275 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:12.668475 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ac4f9-285d-4d27-8ac4-2dc5655fe275 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:12.669478 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ac4f9-285d-4d27-8ac4-2dc5655fe275 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:12.670463 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ac4f9-285d-4d27-8ac4-2dc5655fe275 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:12.672290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ac4f9-285d-4d27-8ac4-2dc5655fe275 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:12.674573 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 391/764] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Jun 15 09:32:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:12.675662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc36ec-6a68-4791-8751-b841f75556ec None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:12.694031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 374/765] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:12.696407 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ac4f9-285d-4d27-8ac4-2dc5655fe275 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:12.803243 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc36ec-6a68-4791-8751-b841f75556ec None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:12.811363 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ac4f9-285d-4d27-8ac4-2dc5655fe275 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:12.842286 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43912e-c53f-468d-a535-1cb781599365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:12.843140 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43912e-c53f-468d-a535-1cb781599365 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:12.843425 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43912e-c53f-468d-a535-1cb781599365 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:12.843704 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43912e-c53f-468d-a535-1cb781599365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:12.850672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35e5e7-1caf-4afa-856d-417ae3392a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:12.851670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35e5e7-1caf-4afa-856d-417ae3392a73 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:12.852193 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35e5e7-1caf-4afa-856d-417ae3392a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:12.852676 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35e5e7-1caf-4afa-856d-417ae3392a73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:12.853684 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35e5e7-1caf-4afa-856d-417ae3392a73 None admin] RBAC: Adding query filter params (interface=public, service_id=8a40904fa21b499dbe3d6b9792613072, region_id=RegionOne) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:12.854224 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35e5e7-1caf-4afa-856d-417ae3392a73 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:12.855041 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43912e-c53f-468d-a535-1cb781599365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:12.856159 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35e5e7-1caf-4afa-856d-417ae3392a73 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:12.856497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43912e-c53f-468d-a535-1cb781599365 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:12.866401 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 375/766] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Jun 15 09:32:12 2022] GET /identity/v3/endpoints?service_id=8a40904fa21b499dbe3d6b9792613072&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:12.867696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35e5e7-1caf-4afa-856d-417ae3392a73 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:12.878116 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:12.886936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6a43912e-c53f-468d-a535-1cb781599365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:12.886936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:12.886936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:12.886936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:12.886936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:12.886936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:12.886936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:12.886936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:12.886936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:12.886936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:12.886936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:12.886936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:12.886936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:12.886936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:12.886936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:12.889114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:12.890469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:12.890469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:12.890469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:12.890469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:12.893012 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 392/767] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:12.894430 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43912e-c53f-468d-a535-1cb781599365 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:12.922984 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:12.994052 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35e5e7-1caf-4afa-856d-417ae3392a73 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:13.031697 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43912e-c53f-468d-a535-1cb781599365 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:13.033818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffea686-2601-435b-a525-b983f9158cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:13.034876 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffea686-2601-435b-a525-b983f9158cd4 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:13.036003 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffea686-2601-435b-a525-b983f9158cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:13.036003 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffea686-2601-435b-a525-b983f9158cd4 None admin] PATH_INFO: `/v3/projects/b978d75b349941f5bedbe56544f41ada/users/26dbaf7292444c8f9a6d45bfaf96763f/roles/efaf387c51e14931820f2a9b33ac5175` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:13.037952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffea686-2601-435b-a525-b983f9158cd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b978d75b349941f5bedbe56544f41ada, user_id=26dbaf7292444c8f9a6d45bfaf96763f, role_id=efaf387c51e14931820f2a9b33ac5175)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:13.039530 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffea686-2601-435b-a525-b983f9158cd4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:13.066529 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 376/768] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:32:12 2022] PUT /identity/v3/projects/b978d75b349941f5bedbe56544f41ada/users/26dbaf7292444c8f9a6d45bfaf96763f/roles/efaf387c51e14931820f2a9b33ac5175 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:32:13.066529 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffea686-2601-435b-a525-b983f9158cd4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:13.095678 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd074e2-b863-4a3f-b8cb-1557eb6b0a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:13.096763 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd074e2-b863-4a3f-b8cb-1557eb6b0a67 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:13.097275 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd074e2-b863-4a3f-b8cb-1557eb6b0a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:13.097797 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd074e2-b863-4a3f-b8cb-1557eb6b0a67 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:13.098870 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd074e2-b863-4a3f-b8cb-1557eb6b0a67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:13.100623 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd074e2-b863-4a3f-b8cb-1557eb6b0a67 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:13.115720 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 393/769] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Jun 15 09:32:12 2022] GET /identity/v3/services => generated 772 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:13.150945 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:13.196265 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffea686-2601-435b-a525-b983f9158cd4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:13.238450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39245a28-cc93-444f-8d94-6e5a3f23eb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:13.239178 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39245a28-cc93-444f-8d94-6e5a3f23eb1b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:13.239542 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39245a28-cc93-444f-8d94-6e5a3f23eb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:13.240385 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39245a28-cc93-444f-8d94-6e5a3f23eb1b None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:13.241165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39245a28-cc93-444f-8d94-6e5a3f23eb1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:13.241540 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39245a28-cc93-444f-8d94-6e5a3f23eb1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:13.243090 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39245a28-cc93-444f-8d94-6e5a3f23eb1b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:13.258051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 377/770] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:13.263872 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd074e2-b863-4a3f-b8cb-1557eb6b0a67 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:13.407179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:13.453121 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd074e2-b863-4a3f-b8cb-1557eb6b0a67 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:13.504518 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52f61b-b5bf-418a-a307-0a8cd52f53a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:13.505402 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52f61b-b5bf-418a-a307-0a8cd52f53a7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:13.505691 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52f61b-b5bf-418a-a307-0a8cd52f53a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:13.505975 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52f61b-b5bf-418a-a307-0a8cd52f53a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:13.514238 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52f61b-b5bf-418a-a307-0a8cd52f53a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:13.515750 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52f61b-b5bf-418a-a307-0a8cd52f53a7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:13.531004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ce52f61b-b5bf-418a-a307-0a8cd52f53a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:13.531004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:13.531004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:13.531004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:13.531004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:13.531004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:13.531004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:13.531004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:13.531004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:13.531004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:13.531004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:13.531004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:13.531004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:13.531004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:13.531004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:13.531970 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:13.532855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:13.532855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:13.532855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:13.532855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:13.532855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:13.532855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:13.532855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:13.532855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:13.532855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 394/771] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:13.539231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39245a28-cc93-444f-8d94-6e5a3f23eb1b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:13.735473 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39245a28-cc93-444f-8d94-6e5a3f23eb1b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:13.772601 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:13.784158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13886649-2988-4849-a779-958af1a36a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:13.784862 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13886649-2988-4849-a779-958af1a36a9b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:13.785147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13886649-2988-4849-a779-958af1a36a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:13.785431 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13886649-2988-4849-a779-958af1a36a9b None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:13.786260 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13886649-2988-4849-a779-958af1a36a9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:13.787150 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13886649-2988-4849-a779-958af1a36a9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:13.788684 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13886649-2988-4849-a779-958af1a36a9b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:13.802955 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 378/772] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:13.811655 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52f61b-b5bf-418a-a307-0a8cd52f53a7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:13.849725 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4e051-d4a4-41f9-9960-2d139ab30fc2 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:13.850066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4e051-d4a4-41f9-9960-2d139ab30fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:13.850331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4e051-d4a4-41f9-9960-2d139ab30fc2 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:13.851919 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 379/773] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:13.859501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91d5df-1479-4a06-acd8-d09554055ec1 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:13.860235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91d5df-1479-4a06-acd8-d09554055ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:13.860923 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91d5df-1479-4a06-acd8-d09554055ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:13.886012 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bd91d5df-1479-4a06-acd8-d09554055ec1 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:13.888322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bd91d5df-1479-4a06-acd8-d09554055ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:14.013652 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 380/774] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:32:14.053295 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52f61b-b5bf-418a-a307-0a8cd52f53a7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:14.058928 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91d5df-1479-4a06-acd8-d09554055ec1 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:14.155316 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990b744-a549-4728-9099-07baf29b45a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:14.156015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990b744-a549-4728-9099-07baf29b45a1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:14.156312 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990b744-a549-4728-9099-07baf29b45a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:14.156599 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990b744-a549-4728-9099-07baf29b45a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:14.157488 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990b744-a549-4728-9099-07baf29b45a1 None admin] RBAC: Adding query filter params (role.id=0ff0d3dcb5e448c3abc2470461490795, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=57632a25fe1f4b18b75e9774e87d8ffb) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:14.157810 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990b744-a549-4728-9099-07baf29b45a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:14.159448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990b744-a549-4728-9099-07baf29b45a1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:14.177117 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 395/775] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:32:13 2022] GET /identity/v3/role_assignments?user.id=57632a25fe1f4b18b75e9774e87d8ffb&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=0ff0d3dcb5e448c3abc2470461490795 => generated 259 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:14.247601 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91d5df-1479-4a06-acd8-d09554055ec1 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:14.272819 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:14.307915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34d92e-56ef-49f2-8a63-f0654cf6141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:14.309348 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34d92e-56ef-49f2-8a63-f0654cf6141e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:14.310101 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34d92e-56ef-49f2-8a63-f0654cf6141e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:14.310727 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34d92e-56ef-49f2-8a63-f0654cf6141e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:14.334051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34d92e-56ef-49f2-8a63-f0654cf6141e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:32:14.339370 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a66f9-c0bd-4ef7-8fa6-b21f6de53b3a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:14.339701 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a66f9-c0bd-4ef7-8fa6-b21f6de53b3a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:14.339949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a66f9-c0bd-4ef7-8fa6-b21f6de53b3a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:14.341707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 396/776] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3d34d92e-56ef-49f2-8a63-f0654cf6141e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:32:14.344795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:14.346612 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:14.348302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:14.348302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:14.348302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:14.348302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:14.348302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:32:14.348302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:32:14.348302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:32:14.348302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:32:14.348302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:32:14.348302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:32:14.348302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:32:14.348302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:14.351624 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2723b0-447f-434a-9156-522bde4ff598 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:14.351624 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2723b0-447f-434a-9156-522bde4ff598 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:14.351624 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2723b0-447f-434a-9156-522bde4ff598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:14.358695 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 381/777] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:32:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:14.363194 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34d92e-56ef-49f2-8a63-f0654cf6141e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:14.365588 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:14.399705 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6b2723b0-447f-434a-9156-522bde4ff598 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:14.400963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6b2723b0-447f-434a-9156-522bde4ff598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:14.544632 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34d92e-56ef-49f2-8a63-f0654cf6141e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:14.580310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 397/778] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:14.595693 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bba27-2e97-4c2b-8b72-c89e2d3e6ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:14.596390 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bba27-2e97-4c2b-8b72-c89e2d3e6ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:14.596673 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bba27-2e97-4c2b-8b72-c89e2d3e6ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:14.596953 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bba27-2e97-4c2b-8b72-c89e2d3e6ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:14.597734 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bba27-2e97-4c2b-8b72-c89e2d3e6ec8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:14.598045 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bba27-2e97-4c2b-8b72-c89e2d3e6ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:14.599561 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bba27-2e97-4c2b-8b72-c89e2d3e6ec8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:14.609377 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 382/779] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:32:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:14.615859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2723b0-447f-434a-9156-522bde4ff598 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:14.620506 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bba27-2e97-4c2b-8b72-c89e2d3e6ec8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:14.688031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:14.752267 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bba27-2e97-4c2b-8b72-c89e2d3e6ec8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:14.824951 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda54d5-63a1-4e49-a70f-21ec99723f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:14.825681 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda54d5-63a1-4e49-a70f-21ec99723f16 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:14.825973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda54d5-63a1-4e49-a70f-21ec99723f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:14.826257 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda54d5-63a1-4e49-a70f-21ec99723f16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:14.853607 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda54d5-63a1-4e49-a70f-21ec99723f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:14.855151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda54d5-63a1-4e49-a70f-21ec99723f16 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:14.888962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9cda54d5-63a1-4e49-a70f-21ec99723f16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:14.888962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:14.888962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:14.888962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:14.888962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:14.888962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:14.888962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:14.888962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:14.888962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:14.888962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:14.888962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:14.888962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:14.888962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:14.888962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:14.888962 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:14.890209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:14.891691 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:14.891691 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:14.891691 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:14.891691 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:14.891691 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 383/780] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:14.906257 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda54d5-63a1-4e49-a70f-21ec99723f16 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:14.908098 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2723b0-447f-434a-9156-522bde4ff598 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:14.990254 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:14.997076 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766642ca-de9a-404d-a7d4-08d110049494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:14.998924 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766642ca-de9a-404d-a7d4-08d110049494 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:14.999719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766642ca-de9a-404d-a7d4-08d110049494 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:15.000458 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766642ca-de9a-404d-a7d4-08d110049494 None admin] PATH_INFO: `/v3/services/network` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:15.001923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766642ca-de9a-404d-a7d4-08d110049494 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:15.005332 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766642ca-de9a-404d-a7d4-08d110049494 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-766642ca-de9a-404d-a7d4-08d110049494 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:15.042722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:15.044640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:15.046202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:15.046202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:15.046202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:15.046202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:15.046202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:15.046202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:15.046202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:15.046202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:15.046202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:15.046202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:15.046202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:15.046202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:15.046202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 09:32:15.046202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:15.046202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 398/781] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:14 2022] GET /identity/v3/services/network => generated 88 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:15.051443 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766642ca-de9a-404d-a7d4-08d110049494 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:15.135539 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:15.162197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda54d5-63a1-4e49-a70f-21ec99723f16 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:15.240924 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea815b-aee6-4649-865b-f00235627bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:15.241608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea815b-aee6-4649-865b-f00235627bbb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:15.241894 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea815b-aee6-4649-865b-f00235627bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:15.242175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea815b-aee6-4649-865b-f00235627bbb None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:15.244094 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea815b-aee6-4649-865b-f00235627bbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:15.244405 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea815b-aee6-4649-865b-f00235627bbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:15.245804 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea815b-aee6-4649-865b-f00235627bbb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:15.280693 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 384/782] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:15.282968 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea815b-aee6-4649-865b-f00235627bbb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:15.298369 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766642ca-de9a-404d-a7d4-08d110049494 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:15.375567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d50ff-3cba-4f76-ab43-b76df604d294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:15.376266 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d50ff-3cba-4f76-ab43-b76df604d294 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:15.376568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d50ff-3cba-4f76-ab43-b76df604d294 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:15.376854 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d50ff-3cba-4f76-ab43-b76df604d294 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:15.377578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d50ff-3cba-4f76-ab43-b76df604d294 None admin] RBAC: Adding query filter params (name=network) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:15.377891 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d50ff-3cba-4f76-ab43-b76df604d294 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:15.379942 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d50ff-3cba-4f76-ab43-b76df604d294 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:15.387031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 399/783] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Jun 15 09:32:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:15.393856 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d50ff-3cba-4f76-ab43-b76df604d294 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:15.437751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea815b-aee6-4649-865b-f00235627bbb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:15.488414 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fd1b7-2b02-484e-8ec0-8a2ff5fa6ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:15.489264 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fd1b7-2b02-484e-8ec0-8a2ff5fa6ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:15.489609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fd1b7-2b02-484e-8ec0-8a2ff5fa6ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:15.489891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fd1b7-2b02-484e-8ec0-8a2ff5fa6ba4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:15.506910 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fd1b7-2b02-484e-8ec0-8a2ff5fa6ba4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:15.508519 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fd1b7-2b02-484e-8ec0-8a2ff5fa6ba4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a62fd1b7-2b02-484e-8ec0-8a2ff5fa6ba4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:32:15.534933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:15.536665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:15.538326 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:15.538326 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:15.538326 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:32:15.538326 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:32:15.538326 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:32:15.538326 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:32:15.538326 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:32:15.538326 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:32:15.538326 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 09:32:15.538326 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:15.548478 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 385/784] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:32:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:15.559466 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fd1b7-2b02-484e-8ec0-8a2ff5fa6ba4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:15.574914 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:15.600817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:15.703007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d50ff-3cba-4f76-ab43-b76df604d294 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:15.788000 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e80e9-3e42-4684-9020-6d2f634c8be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:15.789522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e80e9-3e42-4684-9020-6d2f634c8be5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:15.790224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e80e9-3e42-4684-9020-6d2f634c8be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:15.790950 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e80e9-3e42-4684-9020-6d2f634c8be5 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:15.793482 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e80e9-3e42-4684-9020-6d2f634c8be5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:15.794303 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e80e9-3e42-4684-9020-6d2f634c8be5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:15.797567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e80e9-3e42-4684-9020-6d2f634c8be5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:15.818842 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 400/785] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Jun 15 09:32:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:15.821102 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fd1b7-2b02-484e-8ec0-8a2ff5fa6ba4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:15.821722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02abeb6-1ac7-4d17-871f-c7941a72fb78 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:15.822398 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02abeb6-1ac7-4d17-871f-c7941a72fb78 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:15.823116 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02abeb6-1ac7-4d17-871f-c7941a72fb78 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:15.826111 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 401/786] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:15.827760 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02abeb6-1ac7-4d17-871f-c7941a72fb78 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:15.887516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045ede4-7978-46c4-801b-ef8e00e8e837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:15.889036 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045ede4-7978-46c4-801b-ef8e00e8e837 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:15.889508 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045ede4-7978-46c4-801b-ef8e00e8e837 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:15.890331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045ede4-7978-46c4-801b-ef8e00e8e837 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:15.896113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045ede4-7978-46c4-801b-ef8e00e8e837 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:15.896977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045ede4-7978-46c4-801b-ef8e00e8e837 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:15.898795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045ede4-7978-46c4-801b-ef8e00e8e837 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:15.923878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 386/787] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Jun 15 09:32:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:15.925265 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92953e8e-d112-438a-a69b-c79b3817d20d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:15.925563 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92953e8e-d112-438a-a69b-c79b3817d20d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:15.931082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92953e8e-d112-438a-a69b-c79b3817d20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:15.950792 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-92953e8e-d112-438a-a69b-c79b3817d20d None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:15.952172 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-92953e8e-d112-438a-a69b-c79b3817d20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:16.004109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02abeb6-1ac7-4d17-871f-c7941a72fb78 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:16.058901 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:16.064523 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb12e09-06fa-4ec6-b2f9-4971021e3b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:16.065209 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb12e09-06fa-4ec6-b2f9-4971021e3b54 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:16.065495 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb12e09-06fa-4ec6-b2f9-4971021e3b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:16.065770 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb12e09-06fa-4ec6-b2f9-4971021e3b54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:16.066635 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb12e09-06fa-4ec6-b2f9-4971021e3b54 None admin] RBAC: Adding query filter params (interface=public, service_id=fb9a73faa2994383bd6e981dd6b9c8d4, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:16.066956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb12e09-06fa-4ec6-b2f9-4971021e3b54 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:16.069035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb12e09-06fa-4ec6-b2f9-4971021e3b54 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:16.079608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:16.081513 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 402/788] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Jun 15 09:32:15 2022] GET /identity/v3/endpoints?service_id=fb9a73faa2994383bd6e981dd6b9c8d4&interface=public®ion_id=RegionOne => generated 194 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:16.086718 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 387/789] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:16.087891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92953e8e-d112-438a-a69b-c79b3817d20d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:16.091083 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de667fc9-39a1-4739-82d6-aaf2776ad4a2 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:16.091595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de667fc9-39a1-4739-82d6-aaf2776ad4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:16.092082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de667fc9-39a1-4739-82d6-aaf2776ad4a2 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:16.098669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 403/790] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:16.098669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de667fc9-39a1-4739-82d6-aaf2776ad4a2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:16.213044 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92953e8e-d112-438a-a69b-c79b3817d20d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:16.258429 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de667fc9-39a1-4739-82d6-aaf2776ad4a2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:16.267029 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156618bf-74b5-4c42-8ccc-9115c33d6fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:16.268657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156618bf-74b5-4c42-8ccc-9115c33d6fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:16.268897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156618bf-74b5-4c42-8ccc-9115c33d6fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:16.269387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156618bf-74b5-4c42-8ccc-9115c33d6fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:16.283541 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156618bf-74b5-4c42-8ccc-9115c33d6fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:16.285006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156618bf-74b5-4c42-8ccc-9115c33d6fe0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:16.302909 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49eeae-6dde-46ae-b5c4-c976a099c68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:16.303670 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49eeae-6dde-46ae-b5c4-c976a099c68d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:16.303923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49eeae-6dde-46ae-b5c4-c976a099c68d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:16.304197 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49eeae-6dde-46ae-b5c4-c976a099c68d None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:16.304890 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49eeae-6dde-46ae-b5c4-c976a099c68d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:16.305057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-156618bf-74b5-4c42-8ccc-9115c33d6fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:16.305057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:16.305057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:16.305057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:16.305057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:16.305057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:16.305057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:16.305057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:16.305057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:16.305057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:16.305057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:16.305057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:16.305057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:16.305057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:16.305057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:16.306997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:16.308750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:16.308750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:16.308750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:16.308750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:16.310090 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49eeae-6dde-46ae-b5c4-c976a099c68d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:16.310429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 388/791] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:16.310429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdf676-299c-41d4-bfbf-b278dc3a8bb6 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:16.310429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdf676-299c-41d4-bfbf-b278dc3a8bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:16.310429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdf676-299c-41d4-bfbf-b278dc3a8bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:16.317403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 404/792] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Jun 15 09:32:16 2022] GET /identity/v3/services => generated 772 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:16.318071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49eeae-6dde-46ae-b5c4-c976a099c68d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:16.350487 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7cbdf676-299c-41d4-bfbf-b278dc3a8bb6 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:16.354882 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7cbdf676-299c-41d4-bfbf-b278dc3a8bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:16.395532 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:16.458556 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:16.474281 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49eeae-6dde-46ae-b5c4-c976a099c68d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:16.504170 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 389/793] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:16.506128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdf676-299c-41d4-bfbf-b278dc3a8bb6 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:16.531671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3483d7-cd8e-4b09-9049-9d3aacb8466f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:16.532532 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3483d7-cd8e-4b09-9049-9d3aacb8466f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:16.532814 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3483d7-cd8e-4b09-9049-9d3aacb8466f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:16.533097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3483d7-cd8e-4b09-9049-9d3aacb8466f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:16.553459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3483d7-cd8e-4b09-9049-9d3aacb8466f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ab3483d7-cd8e-4b09-9049-9d3aacb8466f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:32:16.563496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:16.565375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:16.567082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:16.567082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:16.567082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:16.567082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:16.567082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:32:16.567082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:32:16.567082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:32:16.567082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:32:16.567082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:32:16.567082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:32:16.567082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:32:16.567082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:16.567082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 405/794] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:32:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:16.567082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3483d7-cd8e-4b09-9049-9d3aacb8466f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:16.694546 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdf676-299c-41d4-bfbf-b278dc3a8bb6 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:16.773768 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67c660-c90a-4c04-aa79-635721954831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:16.775278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67c660-c90a-4c04-aa79-635721954831 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:16.775914 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67c660-c90a-4c04-aa79-635721954831 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:16.776397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67c660-c90a-4c04-aa79-635721954831 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:16.777719 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67c660-c90a-4c04-aa79-635721954831 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:16.778233 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67c660-c90a-4c04-aa79-635721954831 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:16.780336 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3483d7-cd8e-4b09-9049-9d3aacb8466f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:16.780659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67c660-c90a-4c04-aa79-635721954831 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:16.807037 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 390/795] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:16.808978 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67c660-c90a-4c04-aa79-635721954831 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:16.813823 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:16.863352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8e4ca-3013-4c43-9238-be8fa199ac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:16.865501 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8e4ca-3013-4c43-9238-be8fa199ac10 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:16.866316 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8e4ca-3013-4c43-9238-be8fa199ac10 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:16.867167 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8e4ca-3013-4c43-9238-be8fa199ac10 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:16.868739 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8e4ca-3013-4c43-9238-be8fa199ac10 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:16.871799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8e4ca-3013-4c43-9238-be8fa199ac10 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f2e8e4ca-3013-4c43-9238-be8fa199ac10 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:16.898746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:16.900659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:16.902384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:16.902384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:16.902384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:16.902384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:16.902384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:16.902384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:16.902384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:16.902384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:16.902384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:16.902384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:16.902384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:16.902384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:16.902384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:16.902384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 09:32:16.902384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:16.904049 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:16.914916 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 406/796] 10.222.0.45 () {56 vars in 1129 bytes} [Wed Jun 15 09:32:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:16.917213 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8e4ca-3013-4c43-9238-be8fa199ac10 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:17.031385 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67c660-c90a-4c04-aa79-635721954831 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:17.100393 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca0ef7-9a0a-4af4-b8a8-1cbf390e8f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:17.101457 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca0ef7-9a0a-4af4-b8a8-1cbf390e8f2c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:17.101974 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca0ef7-9a0a-4af4-b8a8-1cbf390e8f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:17.102850 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca0ef7-9a0a-4af4-b8a8-1cbf390e8f2c None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:17.103806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca0ef7-9a0a-4af4-b8a8-1cbf390e8f2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:17.104309 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca0ef7-9a0a-4af4-b8a8-1cbf390e8f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:17.106789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca0ef7-9a0a-4af4-b8a8-1cbf390e8f2c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:17.111777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8e4ca-3013-4c43-9238-be8fa199ac10 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:17.129817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 391/797] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:32:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:17.129817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca0ef7-9a0a-4af4-b8a8-1cbf390e8f2c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:17.179550 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde65f3-22fb-4e38-b181-f2390bccb659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:17.181110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde65f3-22fb-4e38-b181-f2390bccb659 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:17.181110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde65f3-22fb-4e38-b181-f2390bccb659 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:17.181559 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde65f3-22fb-4e38-b181-f2390bccb659 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:17.193484 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde65f3-22fb-4e38-b181-f2390bccb659 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:17.195998 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde65f3-22fb-4e38-b181-f2390bccb659 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:17.223307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7cde65f3-22fb-4e38-b181-f2390bccb659 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:17.223307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:17.223307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:17.223307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:17.223307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:17.223307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:17.223307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:17.223307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:17.223307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:17.223307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:17.223307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:17.223307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:17.223307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:17.223307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:17.223307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:17.225673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:17.227522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:17.227522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:17.227522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:17.227522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:17.227522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:17.227522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:17.227522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:17.227522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:17.227522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 407/798] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:17.227522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56104c5-b0d0-45a4-b0c2-460b1d6cb396 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:17.227522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56104c5-b0d0-45a4-b0c2-460b1d6cb396 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:17.228775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56104c5-b0d0-45a4-b0c2-460b1d6cb396 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:17.228775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 408/799] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:17.237811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56104c5-b0d0-45a4-b0c2-460b1d6cb396 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:17.309470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:17.324937 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca0ef7-9a0a-4af4-b8a8-1cbf390e8f2c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:17.328185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:17.391821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abea97-fa0a-49dd-b9d7-1e635ff81e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:17.392791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abea97-fa0a-49dd-b9d7-1e635ff81e8b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:17.393249 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abea97-fa0a-49dd-b9d7-1e635ff81e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:17.393677 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abea97-fa0a-49dd-b9d7-1e635ff81e8b None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:17.394966 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abea97-fa0a-49dd-b9d7-1e635ff81e8b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:17.396036 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abea97-fa0a-49dd-b9d7-1e635ff81e8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:17.398413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abea97-fa0a-49dd-b9d7-1e635ff81e8b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:17.406878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 392/800] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Jun 15 09:32:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:17.408828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10231dcf-75ba-4853-9528-12c00b504d77 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:17.409226 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10231dcf-75ba-4853-9528-12c00b504d77 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:17.409591 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10231dcf-75ba-4853-9528-12c00b504d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:17.434989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-10231dcf-75ba-4853-9528-12c00b504d77 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:17.436994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-10231dcf-75ba-4853-9528-12c00b504d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:17.444904 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56104c5-b0d0-45a4-b0c2-460b1d6cb396 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:17.510317 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0460e0-0c26-4a0a-bff7-1df8c283dbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:17.511511 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0460e0-0c26-4a0a-bff7-1df8c283dbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:17.511932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0460e0-0c26-4a0a-bff7-1df8c283dbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:17.512352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0460e0-0c26-4a0a-bff7-1df8c283dbf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:17.537587 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0460e0-0c26-4a0a-bff7-1df8c283dbf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:17.539839 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0460e0-0c26-4a0a-bff7-1df8c283dbf0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:17.550613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 393/801] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:17.550613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10231dcf-75ba-4853-9528-12c00b504d77 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:17.585764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8e0460e0-0c26-4a0a-bff7-1df8c283dbf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:17.585764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:17.585764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:17.585764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:17.585764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:17.585764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:17.585764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:17.585764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:17.585764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:17.585764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:17.585764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:17.585764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:17.585764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:17.585764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:17.585764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:17.587636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:17.589299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:17.589299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:17.589299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:17.589299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:17.590753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 409/802] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:17.592615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0460e0-0c26-4a0a-bff7-1df8c283dbf0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:17.742989 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:17.746975 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:17.757268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10231dcf-75ba-4853-9528-12c00b504d77 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:17.769279 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0460e0-0c26-4a0a-bff7-1df8c283dbf0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:17.803860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da36ad1-ce77-4476-8dc3-e46f303bed91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:17.805052 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da36ad1-ce77-4476-8dc3-e46f303bed91 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:17.805529 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da36ad1-ce77-4476-8dc3-e46f303bed91 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:17.806029 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da36ad1-ce77-4476-8dc3-e46f303bed91 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:17.807636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da36ad1-ce77-4476-8dc3-e46f303bed91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:17.808200 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da36ad1-ce77-4476-8dc3-e46f303bed91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:17.811063 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da36ad1-ce77-4476-8dc3-e46f303bed91 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:17.825152 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf537f19-f7a9-45ca-ab9b-77188ee36698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:17.826138 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf537f19-f7a9-45ca-ab9b-77188ee36698 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:17.826609 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf537f19-f7a9-45ca-ab9b-77188ee36698 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:17.827033 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf537f19-f7a9-45ca-ab9b-77188ee36698 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:17.827922 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf537f19-f7a9-45ca-ab9b-77188ee36698 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:17.828419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf537f19-f7a9-45ca-ab9b-77188ee36698 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:17.830070 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf537f19-f7a9-45ca-ab9b-77188ee36698 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:17.835311 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 394/803] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:17.836929 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da36ad1-ce77-4476-8dc3-e46f303bed91 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:17.837659 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 410/804] 10.222.0.45 () {56 vars in 1124 bytes} [Wed Jun 15 09:32:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:17.838556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf537f19-f7a9-45ca-ab9b-77188ee36698 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:18.005748 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf537f19-f7a9-45ca-ab9b-77188ee36698 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:18.036922 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da36ad1-ce77-4476-8dc3-e46f303bed91 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:18.070251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685a69f-b9e3-4ae9-8d4f-478e726246bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:18.071786 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685a69f-b9e3-4ae9-8d4f-478e726246bd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:18.072163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685a69f-b9e3-4ae9-8d4f-478e726246bd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:18.072696 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685a69f-b9e3-4ae9-8d4f-478e726246bd None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:18.074442 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685a69f-b9e3-4ae9-8d4f-478e726246bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:18.075342 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685a69f-b9e3-4ae9-8d4f-478e726246bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:18.077965 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685a69f-b9e3-4ae9-8d4f-478e726246bd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:18.099416 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a659c1d-8ded-4812-ae77-0058a1e681ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:18.104157 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 411/805] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:18.104326 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a659c1d-8ded-4812-ae77-0058a1e681ef None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:18.104326 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a659c1d-8ded-4812-ae77-0058a1e681ef None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:18.104486 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685a69f-b9e3-4ae9-8d4f-478e726246bd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:18.104561 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a659c1d-8ded-4812-ae77-0058a1e681ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:18.125136 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a659c1d-8ded-4812-ae77-0058a1e681ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:32:18.133098 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-1a659c1d-8ded-4812-ae77-0058a1e681ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:32:18.141990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:18.143066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:18.143915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:18.143915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:18.143915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:18.143915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:18.143915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:32:18.143915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:32:18.143915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:32:18.143915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:32:18.143915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:32:18.143915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:32:18.143915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:32:18.143915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:18.144728 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 395/806] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:32:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:18.146310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a659c1d-8ded-4812-ae77-0058a1e681ef None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:18.257210 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685a69f-b9e3-4ae9-8d4f-478e726246bd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:18.300364 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15931e50-398c-41b0-b62f-359414dddfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:18.302169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15931e50-398c-41b0-b62f-359414dddfaa None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:18.302676 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15931e50-398c-41b0-b62f-359414dddfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:18.303160 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15931e50-398c-41b0-b62f-359414dddfaa None admin] PATH_INFO: `/v3/projects/b978d75b349941f5bedbe56544f41ada/users/cdbfc031f967416e9a2c94bce3d28f66/roles/efaf387c51e14931820f2a9b33ac5175` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:18.305485 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15931e50-398c-41b0-b62f-359414dddfaa None admin] RBAC: Authorizing `identity:create_grant(project_id=b978d75b349941f5bedbe56544f41ada, user_id=cdbfc031f967416e9a2c94bce3d28f66, role_id=efaf387c51e14931820f2a9b33ac5175)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:18.307293 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15931e50-398c-41b0-b62f-359414dddfaa None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:18.333136 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 412/807] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:32:18 2022] PUT /identity/v3/projects/b978d75b349941f5bedbe56544f41ada/users/cdbfc031f967416e9a2c94bce3d28f66/roles/efaf387c51e14931820f2a9b33ac5175 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:32:18.333136 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15931e50-398c-41b0-b62f-359414dddfaa None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:18.359646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:18.504323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:18.574944 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15931e50-398c-41b0-b62f-359414dddfaa None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:18.588072 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a659c1d-8ded-4812-ae77-0058a1e681ef None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:18.636693 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67be8c-c6b6-4e94-b1fe-ba6a01d7da90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:18.637450 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67be8c-c6b6-4e94-b1fe-ba6a01d7da90 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:18.637990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67be8c-c6b6-4e94-b1fe-ba6a01d7da90 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:18.638271 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67be8c-c6b6-4e94-b1fe-ba6a01d7da90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:18.639058 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67be8c-c6b6-4e94-b1fe-ba6a01d7da90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:18.640691 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67be8c-c6b6-4e94-b1fe-ba6a01d7da90 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:18.651143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054825f4-1eb7-4e2d-baa1-ecacb13d2414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:18.654466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054825f4-1eb7-4e2d-baa1-ecacb13d2414 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:18.654711 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054825f4-1eb7-4e2d-baa1-ecacb13d2414 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:18.655013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054825f4-1eb7-4e2d-baa1-ecacb13d2414 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:18.670667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054825f4-1eb7-4e2d-baa1-ecacb13d2414 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:18.672958 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 396/808] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Jun 15 09:32:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:32:18.673891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67be8c-c6b6-4e94-b1fe-ba6a01d7da90 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:18.674961 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054825f4-1eb7-4e2d-baa1-ecacb13d2414 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-054825f4-1eb7-4e2d-baa1-ecacb13d2414 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:32:18.714980 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:18.716877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:18.720299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:18.720299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:18.720299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:32:18.720299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:32:18.720299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:32:18.720299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:32:18.720299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:32:18.720299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:32:18.720299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:32:18.720299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:18.726018 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 413/809] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Jun 15 09:32:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:18.733827 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054825f4-1eb7-4e2d-baa1-ecacb13d2414 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:18.854127 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:18.940912 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67be8c-c6b6-4e94-b1fe-ba6a01d7da90 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:18.971315 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054825f4-1eb7-4e2d-baa1-ecacb13d2414 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:19.009372 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:19.017705 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ac9d3-8bb6-4ec9-9310-02268d888c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:19.019209 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ac9d3-8bb6-4ec9-9310-02268d888c4b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:19.019496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ac9d3-8bb6-4ec9-9310-02268d888c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:19.019783 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ac9d3-8bb6-4ec9-9310-02268d888c4b None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:19.021181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ac9d3-8bb6-4ec9-9310-02268d888c4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:19.021549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ac9d3-8bb6-4ec9-9310-02268d888c4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:19.023015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ac9d3-8bb6-4ec9-9310-02268d888c4b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:19.045807 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 414/810] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Jun 15 09:32:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:19.051906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a749-fef9-4ba4-8028-31d9f25a8ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:19.052202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ac9d3-8bb6-4ec9-9310-02268d888c4b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:19.054055 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a749-fef9-4ba4-8028-31d9f25a8ebb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:19.054938 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a749-fef9-4ba4-8028-31d9f25a8ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:19.055775 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a749-fef9-4ba4-8028-31d9f25a8ebb None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:19.059051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026a749-fef9-4ba4-8028-31d9f25a8ebb None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:19.059309 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026a749-fef9-4ba4-8028-31d9f25a8ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:19.062779 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026a749-fef9-4ba4-8028-31d9f25a8ebb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:19.072026 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 397/811] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:32:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:19.081178 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a749-fef9-4ba4-8028-31d9f25a8ebb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:19.251566 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026a749-fef9-4ba4-8028-31d9f25a8ebb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:19.279175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ac9d3-8bb6-4ec9-9310-02268d888c4b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:19.284990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:19.291732 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432fe39-10cc-46c4-811a-506ab90be303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:19.292792 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432fe39-10cc-46c4-811a-506ab90be303 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:19.293231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432fe39-10cc-46c4-811a-506ab90be303 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:19.293666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432fe39-10cc-46c4-811a-506ab90be303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:19.305832 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432fe39-10cc-46c4-811a-506ab90be303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:19.307614 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432fe39-10cc-46c4-811a-506ab90be303 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:19.327304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b432fe39-10cc-46c4-811a-506ab90be303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:19.327304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:19.327304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:19.327304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:19.327304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:19.327304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:19.327304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:19.327304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:19.327304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:19.327304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:19.327304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:19.327304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:19.327304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:19.327304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:19.327304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:19.328477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:19.329581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:19.329581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:19.329581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:19.329581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:19.331595 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 398/812] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:19.334145 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d4cdf-b2d0-474f-95c9-fdf0aff95ff1 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:19.334643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d4cdf-b2d0-474f-95c9-fdf0aff95ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:19.335075 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d4cdf-b2d0-474f-95c9-fdf0aff95ff1 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:19.340673 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 399/813] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:19.341880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d4cdf-b2d0-474f-95c9-fdf0aff95ff1 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:19.355448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fefa8-8f9e-4276-ad09-9e68d45d7e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:19.357313 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fefa8-8f9e-4276-ad09-9e68d45d7e40 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:19.357817 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fefa8-8f9e-4276-ad09-9e68d45d7e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:19.358317 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fefa8-8f9e-4276-ad09-9e68d45d7e40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:19.485246 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:19.499382 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d4cdf-b2d0-474f-95c9-fdf0aff95ff1 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:19.515751 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fefa8-8f9e-4276-ad09-9e68d45d7e40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:19.522681 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fefa8-8f9e-4276-ad09-9e68d45d7e40 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:19.572402 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca11a9-c4c4-443a-93c7-63fc413ef30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:19.573590 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca11a9-c4c4-443a-93c7-63fc413ef30d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:19.574107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca11a9-c4c4-443a-93c7-63fc413ef30d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:19.574675 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca11a9-c4c4-443a-93c7-63fc413ef30d None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:19.576625 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca11a9-c4c4-443a-93c7-63fc413ef30d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:19.577200 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca11a9-c4c4-443a-93c7-63fc413ef30d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:19.580920 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca11a9-c4c4-443a-93c7-63fc413ef30d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:19.611026 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 400/814] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:19.612754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9041889-4aa7-4d6a-a5b0-421460e472b9 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:19.613342 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9041889-4aa7-4d6a-a5b0-421460e472b9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:19.613826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9041889-4aa7-4d6a-a5b0-421460e472b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:19.633917 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c9041889-4aa7-4d6a-a5b0-421460e472b9 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:19.635568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c9041889-4aa7-4d6a-a5b0-421460e472b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:19.684496 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:19.706689 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 415/815] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:32:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:32:19.708029 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fefa8-8f9e-4276-ad09-9e68d45d7e40 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:19.738711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 401/816] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:19.740581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9041889-4aa7-4d6a-a5b0-421460e472b9 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:19.884842 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9041889-4aa7-4d6a-a5b0-421460e472b9 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:19.897100 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:19.914365 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fefa8-8f9e-4276-ad09-9e68d45d7e40 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:19.930380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f1a8c-bc0d-492b-a028-75a431aacd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:19.931714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f1a8c-bc0d-492b-a028-75a431aacd41 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:19.932214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f1a8c-bc0d-492b-a028-75a431aacd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:19.932728 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f1a8c-bc0d-492b-a028-75a431aacd41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:19.946036 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f1a8c-bc0d-492b-a028-75a431aacd41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:19.947892 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f1a8c-bc0d-492b-a028-75a431aacd41 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:19.967331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-8d7f1a8c-bc0d-492b-a028-75a431aacd41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:19.967331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:19.967331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:19.967331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:19.967331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:19.967331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:19.967331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:19.967331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:19.967331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:19.967331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:19.967331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:19.967331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:19.967331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:19.967331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:19.967331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:19.968303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:19.969197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:19.969197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:19.969197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:19.969197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:19.971625 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 402/817] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:19.972719 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f1a8c-bc0d-492b-a028-75a431aacd41 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:19.991846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504dad5-14e5-4862-b0fa-cf4394ae14b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:19.993368 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504dad5-14e5-4862-b0fa-cf4394ae14b2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:19.995036 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504dad5-14e5-4862-b0fa-cf4394ae14b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:19.995036 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504dad5-14e5-4862-b0fa-cf4394ae14b2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:20.004557 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:20.025066 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504dad5-14e5-4862-b0fa-cf4394ae14b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:20.029157 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504dad5-14e5-4862-b0fa-cf4394ae14b2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-3504dad5-14e5-4862-b0fa-cf4394ae14b2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:32:20.068954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:20.069988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:20.071358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:20.071358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:20.071358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:32:20.071358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:32:20.071358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:32:20.071358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:32:20.071358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:32:20.071358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:32:20.071358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 09:32:20.071358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:20.075053 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 416/818] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Jun 15 09:32:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:20.075053 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504dad5-14e5-4862-b0fa-cf4394ae14b2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:20.132160 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f1a8c-bc0d-492b-a028-75a431aacd41 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:20.173829 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c67a93-f7f0-4165-b6a8-43ba34700b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:20.175011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c67a93-f7f0-4165-b6a8-43ba34700b95 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:20.175523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c67a93-f7f0-4165-b6a8-43ba34700b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:20.176020 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c67a93-f7f0-4165-b6a8-43ba34700b95 None admin] PATH_INFO: `/v3/services/network` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:20.177462 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c67a93-f7f0-4165-b6a8-43ba34700b95 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:20.179130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c67a93-f7f0-4165-b6a8-43ba34700b95 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b4c67a93-f7f0-4165-b6a8-43ba34700b95 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:20.209984 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:20.211351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:20.212214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:20.212214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:20.212214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:20.212214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:20.212214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:20.212214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:20.212214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:20.212214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:20.212214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:20.212214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:20.212214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:20.212214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:20.212214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 09:32:20.212214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:20.214574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 403/819] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:19 2022] GET /identity/v3/services/network => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:20.215696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c67a93-f7f0-4165-b6a8-43ba34700b95 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:20.239942 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504dad5-14e5-4862-b0fa-cf4394ae14b2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:20.296918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d09e10-42da-4e06-977b-a748476a832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:20.298002 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d09e10-42da-4e06-977b-a748476a832b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:20.298517 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d09e10-42da-4e06-977b-a748476a832b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:20.299003 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d09e10-42da-4e06-977b-a748476a832b None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:20.300009 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d09e10-42da-4e06-977b-a748476a832b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:20.300588 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d09e10-42da-4e06-977b-a748476a832b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:20.302789 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d09e10-42da-4e06-977b-a748476a832b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:20.338633 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 417/820] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:20.339975 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d09e10-42da-4e06-977b-a748476a832b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:20.370253 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:20.377572 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:20.388961 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c67a93-f7f0-4165-b6a8-43ba34700b95 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:20.462266 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e84562-5c9e-45fa-8270-f023dd466c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:20.463334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e84562-5c9e-45fa-8270-f023dd466c04 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:20.463867 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e84562-5c9e-45fa-8270-f023dd466c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:20.464406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e84562-5c9e-45fa-8270-f023dd466c04 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:20.465528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e84562-5c9e-45fa-8270-f023dd466c04 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:20.466067 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e84562-5c9e-45fa-8270-f023dd466c04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:20.467999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e84562-5c9e-45fa-8270-f023dd466c04 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:20.490975 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 404/821] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Jun 15 09:32:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:20.492245 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e84562-5c9e-45fa-8270-f023dd466c04 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:20.515919 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d09e10-42da-4e06-977b-a748476a832b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:20.562129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea4b38-baab-4c88-8ed1-54b0ab94900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:20.563342 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea4b38-baab-4c88-8ed1-54b0ab94900d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:20.563837 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea4b38-baab-4c88-8ed1-54b0ab94900d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:20.564351 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea4b38-baab-4c88-8ed1-54b0ab94900d None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:20.565287 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea4b38-baab-4c88-8ed1-54b0ab94900d None admin] RBAC: Adding query filter params (name=network) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:20.565804 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea4b38-baab-4c88-8ed1-54b0ab94900d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:20.567646 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea4b38-baab-4c88-8ed1-54b0ab94900d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:20.574853 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 418/822] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Jun 15 09:32:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:20.575998 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea4b38-baab-4c88-8ed1-54b0ab94900d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:20.694134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e84562-5c9e-45fa-8270-f023dd466c04 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:20.710132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:20.747873 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea4b38-baab-4c88-8ed1-54b0ab94900d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:20.772775 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d484c-face-487e-9dfe-eb41413717ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:20.774187 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d484c-face-487e-9dfe-eb41413717ed None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:20.774600 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d484c-face-487e-9dfe-eb41413717ed None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:20.775023 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d484c-face-487e-9dfe-eb41413717ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:20.787740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d484c-face-487e-9dfe-eb41413717ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:20.790155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d484c-face-487e-9dfe-eb41413717ed None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:20.792019 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962079f-7bc9-4c93-8d2e-9847e5dc4c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:20.793235 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962079f-7bc9-4c93-8d2e-9847e5dc4c85 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:20.793746 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962079f-7bc9-4c93-8d2e-9847e5dc4c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:20.794231 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962079f-7bc9-4c93-8d2e-9847e5dc4c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:20.807873 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962079f-7bc9-4c93-8d2e-9847e5dc4c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:20.809879 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962079f-7bc9-4c93-8d2e-9847e5dc4c85 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:20.816151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-620d484c-face-487e-9dfe-eb41413717ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:20.816151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:20.816151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:20.816151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:20.816151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:20.816151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:20.816151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:20.816151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:20.816151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:20.816151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:20.816151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:20.816151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:20.816151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:20.816151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:20.816151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:20.817708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:20.818668 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:20.818668 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:20.818668 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:20.818668 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:20.818668 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:20.818668 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:20.818668 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:20.818668 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:20.827046 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 405/823] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:20.828690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d484c-face-487e-9dfe-eb41413717ed None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:20.836667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e962079f-7bc9-4c93-8d2e-9847e5dc4c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:20.836667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:20.836667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:20.836667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:20.836667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:20.836667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:20.836667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:20.836667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:20.836667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:20.836667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:20.836667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:20.836667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:20.836667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:20.836667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:20.836667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:20.837653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:20.839099 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:20.839099 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:20.839099 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:20.839099 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:20.841257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 419/824] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:20.842459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962079f-7bc9-4c93-8d2e-9847e5dc4c85 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:20.849625 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:21.029558 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d484c-face-487e-9dfe-eb41413717ed None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:21.077357 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962079f-7bc9-4c93-8d2e-9847e5dc4c85 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:21.094345 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dee72-8401-4164-98e4-46188419f0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:21.095803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dee72-8401-4164-98e4-46188419f0bf None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:21.096308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dee72-8401-4164-98e4-46188419f0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:21.096799 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dee72-8401-4164-98e4-46188419f0bf None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:21.098178 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11dee72-8401-4164-98e4-46188419f0bf None admin] RBAC: Adding query filter params (type=network) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:21.098913 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11dee72-8401-4164-98e4-46188419f0bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:21.101672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11dee72-8401-4164-98e4-46188419f0bf None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:21.104511 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:21.115436 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7c9a1-a47a-468b-8722-08abab9f2e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:21.116111 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7c9a1-a47a-468b-8722-08abab9f2e4a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:21.116392 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7c9a1-a47a-468b-8722-08abab9f2e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:21.116667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7c9a1-a47a-468b-8722-08abab9f2e4a None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:21.117469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7c9a1-a47a-468b-8722-08abab9f2e4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:21.117780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7c9a1-a47a-468b-8722-08abab9f2e4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:21.119280 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7c9a1-a47a-468b-8722-08abab9f2e4a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:21.121788 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 406/825] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Jun 15 09:32:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:21.123461 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dee72-8401-4164-98e4-46188419f0bf None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:21.138096 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 420/826] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:21.138096 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e59036-da63-4013-a67e-478776ce7b50 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:21.138096 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e59036-da63-4013-a67e-478776ce7b50 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:21.138096 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e59036-da63-4013-a67e-478776ce7b50 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:21.138096 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 421/827] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:21.138096 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e59036-da63-4013-a67e-478776ce7b50 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:21.222598 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:21.270211 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dee72-8401-4164-98e4-46188419f0bf None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:21.283795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e59036-da63-4013-a67e-478776ce7b50 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:21.331971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11063bc3-8ea3-45f2-94aa-3ac18d8b88ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:21.333233 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11063bc3-8ea3-45f2-94aa-3ac18d8b88ef None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:21.333745 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11063bc3-8ea3-45f2-94aa-3ac18d8b88ef None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:21.334257 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11063bc3-8ea3-45f2-94aa-3ac18d8b88ef None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:21.335647 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11063bc3-8ea3-45f2-94aa-3ac18d8b88ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:21.336209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11063bc3-8ea3-45f2-94aa-3ac18d8b88ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:21.337631 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb475a48-1848-452f-aa69-1f085202c142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:21.338307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb475a48-1848-452f-aa69-1f085202c142 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:21.338621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb475a48-1848-452f-aa69-1f085202c142 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:21.338847 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11063bc3-8ea3-45f2-94aa-3ac18d8b88ef None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:21.338951 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb475a48-1848-452f-aa69-1f085202c142 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:21.339640 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb475a48-1848-452f-aa69-1f085202c142 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:21.340995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb475a48-1848-452f-aa69-1f085202c142 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:21.366871 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 422/828] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Jun 15 09:32:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:32:21.368768 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 407/829] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:21.369494 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb475a48-1848-452f-aa69-1f085202c142 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:21.372912 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92935d6-0088-422a-ba13-e1966969eec7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:21.372912 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92935d6-0088-422a-ba13-e1966969eec7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:21.372912 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92935d6-0088-422a-ba13-e1966969eec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:21.402727 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b92935d6-0088-422a-ba13-e1966969eec7 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:21.404897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b92935d6-0088-422a-ba13-e1966969eec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:21.457730 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:21.582130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 408/830] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:21.584953 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92935d6-0088-422a-ba13-e1966969eec7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:21.591994 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb475a48-1848-452f-aa69-1f085202c142 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:21.651033 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2d978-c9f9-4287-aa1c-4e825beea185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:21.652335 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2d978-c9f9-4287-aa1c-4e825beea185 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:21.652335 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2d978-c9f9-4287-aa1c-4e825beea185 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:21.652508 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2d978-c9f9-4287-aa1c-4e825beea185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:21.653432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2d978-c9f9-4287-aa1c-4e825beea185 None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=26dbaf7292444c8f9a6d45bfaf96763f) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:21.653752 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2d978-c9f9-4287-aa1c-4e825beea185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:21.655489 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2d978-c9f9-4287-aa1c-4e825beea185 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:21.664291 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 423/831] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:32:21 2022] GET /identity/v3/role_assignments?user.id=26dbaf7292444c8f9a6d45bfaf96763f&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:21.665580 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2d978-c9f9-4287-aa1c-4e825beea185 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:21.671399 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:21.734215 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92935d6-0088-422a-ba13-e1966969eec7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:21.781242 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd27226-1d81-481f-ba38-b1caf6684123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:21.782556 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd27226-1d81-481f-ba38-b1caf6684123 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:21.783138 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd27226-1d81-481f-ba38-b1caf6684123 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:21.783843 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd27226-1d81-481f-ba38-b1caf6684123 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:21.792998 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd27226-1d81-481f-ba38-b1caf6684123 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:21.794955 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd27226-1d81-481f-ba38-b1caf6684123 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:21.812773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9bd27226-1d81-481f-ba38-b1caf6684123 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:21.812773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:21.812773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:21.812773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:21.812773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:21.812773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:21.812773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:21.812773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:21.812773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:21.812773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:21.812773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:21.812773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:21.812773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:21.812773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:21.812773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:21.813702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:21.814609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:21.814609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:21.814609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:21.814609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:21.814609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:21.814609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:21.814609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:21.814609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:21.817522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 409/832] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:21.826117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd27226-1d81-481f-ba38-b1caf6684123 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:21.842485 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2d978-c9f9-4287-aa1c-4e825beea185 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:21.851282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:21.885510 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b683fb-c9e0-4b77-bfd8-e4b1bc1767b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:21.886514 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b683fb-c9e0-4b77-bfd8-e4b1bc1767b4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:21.886817 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b683fb-c9e0-4b77-bfd8-e4b1bc1767b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:21.887099 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b683fb-c9e0-4b77-bfd8-e4b1bc1767b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:21.903044 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b683fb-c9e0-4b77-bfd8-e4b1bc1767b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d7b683fb-c9e0-4b77-bfd8-e4b1bc1767b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:32:21.911803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:21.912795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:21.913637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:21.913637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:21.913637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:21.913637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:21.913637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:32:21.913637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:32:21.913637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:32:21.913637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:32:21.913637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:32:21.913637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:32:21.913637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:32:21.913637 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:21.914282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 424/833] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:32:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:21.922156 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b683fb-c9e0-4b77-bfd8-e4b1bc1767b4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:21.985384 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd27226-1d81-481f-ba38-b1caf6684123 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:22.012066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:22.045633 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774791d2-9761-41bd-87d2-b3a5cd492c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:22.046843 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774791d2-9761-41bd-87d2-b3a5cd492c27 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:22.047365 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774791d2-9761-41bd-87d2-b3a5cd492c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:22.047888 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774791d2-9761-41bd-87d2-b3a5cd492c27 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:22.049477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774791d2-9761-41bd-87d2-b3a5cd492c27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:22.050058 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774791d2-9761-41bd-87d2-b3a5cd492c27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:22.052875 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774791d2-9761-41bd-87d2-b3a5cd492c27 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:22.070691 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 410/834] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:22.080644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774791d2-9761-41bd-87d2-b3a5cd492c27 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:22.089341 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b683fb-c9e0-4b77-bfd8-e4b1bc1767b4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:22.151897 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64b41c-c3e6-4e05-bc1f-603924255c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:22.152805 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64b41c-c3e6-4e05-bc1f-603924255c77 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:22.153160 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64b41c-c3e6-4e05-bc1f-603924255c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:22.153505 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64b41c-c3e6-4e05-bc1f-603924255c77 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:22.154335 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64b41c-c3e6-4e05-bc1f-603924255c77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:22.154747 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64b41c-c3e6-4e05-bc1f-603924255c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:22.156291 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64b41c-c3e6-4e05-bc1f-603924255c77 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:22.170540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 425/835] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:32:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:22.177241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64b41c-c3e6-4e05-bc1f-603924255c77 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:22.213142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:22.256011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774791d2-9761-41bd-87d2-b3a5cd492c27 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:22.298743 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc9361-ee7a-466d-8b6c-dd1680fe8010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:22.300041 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc9361-ee7a-466d-8b6c-dd1680fe8010 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:22.300448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc9361-ee7a-466d-8b6c-dd1680fe8010 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:22.300860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc9361-ee7a-466d-8b6c-dd1680fe8010 None admin] PATH_INFO: `/v3/projects/b978d75b349941f5bedbe56544f41ada/users/57632a25fe1f4b18b75e9774e87d8ffb/roles/0ff0d3dcb5e448c3abc2470461490795` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:22.317738 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64b41c-c3e6-4e05-bc1f-603924255c77 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:22.319751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc9361-ee7a-466d-8b6c-dd1680fe8010 None admin] RBAC: Authorizing `identity:create_grant(project_id=b978d75b349941f5bedbe56544f41ada, user_id=57632a25fe1f4b18b75e9774e87d8ffb, role_id=0ff0d3dcb5e448c3abc2470461490795)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:22.321979 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc9361-ee7a-466d-8b6c-dd1680fe8010 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:22.338895 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 411/836] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:32:22 2022] PUT /identity/v3/projects/b978d75b349941f5bedbe56544f41ada/users/57632a25fe1f4b18b75e9774e87d8ffb/roles/0ff0d3dcb5e448c3abc2470461490795 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:32:22.339960 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17290dad-c830-48aa-8b46-58b219961a6b None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:22.340244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17290dad-c830-48aa-8b46-58b219961a6b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:22.340515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17290dad-c830-48aa-8b46-58b219961a6b None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:22.342055 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 412/837] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:22.347812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71d4fc-54a1-481b-9558-af8dc19723eb None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:22.348050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71d4fc-54a1-481b-9558-af8dc19723eb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:22.350625 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df71d4fc-54a1-481b-9558-af8dc19723eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:22.368979 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9d33e-2c20-44d4-ac36-4ac1deaa4fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:22.369462 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-df71d4fc-54a1-481b-9558-af8dc19723eb None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:22.369795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9d33e-2c20-44d4-ac36-4ac1deaa4fab None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:22.370082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9d33e-2c20-44d4-ac36-4ac1deaa4fab None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:22.370359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9d33e-2c20-44d4-ac36-4ac1deaa4fab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:22.370708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-df71d4fc-54a1-481b-9558-af8dc19723eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:22.384654 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9d33e-2c20-44d4-ac36-4ac1deaa4fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:22.386269 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9d33e-2c20-44d4-ac36-4ac1deaa4fab None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:22.407374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c8e9d33e-2c20-44d4-ac36-4ac1deaa4fab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:22.407374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:22.407374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:22.407374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:22.407374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:22.407374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:22.407374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:22.407374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:22.407374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:22.407374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:22.407374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:22.407374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:22.407374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:22.407374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:22.407374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:22.408358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:22.409277 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:22.409277 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:22.409277 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:22.409277 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:22.413761 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:22.414136 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 426/838] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:32:22.415338 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9d33e-2c20-44d4-ac36-4ac1deaa4fab None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:22.518667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 413/839] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:32:22.547908 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:22.553078 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71d4fc-54a1-481b-9558-af8dc19723eb None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:22.586413 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9d33e-2c20-44d4-ac36-4ac1deaa4fab None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:22.635824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dca57-d3a2-4146-b4f6-a2b5ec7ad0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:22.636915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dca57-d3a2-4146-b4f6-a2b5ec7ad0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:22.637641 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dca57-d3a2-4146-b4f6-a2b5ec7ad0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:22.637990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dca57-d3a2-4146-b4f6-a2b5ec7ad0b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:22.638860 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dca57-d3a2-4146-b4f6-a2b5ec7ad0b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:22.639180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dca57-d3a2-4146-b4f6-a2b5ec7ad0b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:22.640611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dca57-d3a2-4146-b4f6-a2b5ec7ad0b4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:22.657355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 427/840] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:22.667314 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dca57-d3a2-4146-b4f6-a2b5ec7ad0b4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:22.703480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df71d4fc-54a1-481b-9558-af8dc19723eb None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:22.740506 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db536b7b-734b-4d27-b967-5f738cba1141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:22.741317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db536b7b-734b-4d27-b967-5f738cba1141 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:22.741598 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db536b7b-734b-4d27-b967-5f738cba1141 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:22.741873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db536b7b-734b-4d27-b967-5f738cba1141 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:22.742560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db536b7b-734b-4d27-b967-5f738cba1141 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:22.744107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db536b7b-734b-4d27-b967-5f738cba1141 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-db536b7b-734b-4d27-b967-5f738cba1141 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:22.757142 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:22.758403 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:22.759476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:22.759476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:22.759476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:22.759476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:22.759476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:22.759476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:22.759476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:22.759476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:22.759476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:22.759476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:22.759476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:22.759476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:22.759476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 09:32:22.759476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:22.767172 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 414/841] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:32:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:22.771749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db536b7b-734b-4d27-b967-5f738cba1141 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:22.795425 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:22.855256 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dca57-d3a2-4146-b4f6-a2b5ec7ad0b4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:22.882967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db536b7b-734b-4d27-b967-5f738cba1141 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:22.919194 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48f884-6dad-4ed0-bea5-861c5b805dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:22.920724 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48f884-6dad-4ed0-bea5-861c5b805dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:22.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8289768-d118-4da3-96cc-036cecefd943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:22.921463 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48f884-6dad-4ed0-bea5-861c5b805dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:22.922042 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48f884-6dad-4ed0-bea5-861c5b805dc0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:22.922435 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8289768-d118-4da3-96cc-036cecefd943 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:22.922882 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8289768-d118-4da3-96cc-036cecefd943 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:22.923377 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8289768-d118-4da3-96cc-036cecefd943 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:22.924332 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8289768-d118-4da3-96cc-036cecefd943 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:22.924784 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8289768-d118-4da3-96cc-036cecefd943 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:22.926877 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8289768-d118-4da3-96cc-036cecefd943 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:22.932137 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 415/842] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:32:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:22.937795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8289768-d118-4da3-96cc-036cecefd943 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:22.937977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48f884-6dad-4ed0-bea5-861c5b805dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:22.940144 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48f884-6dad-4ed0-bea5-861c5b805dc0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:22.947362 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9f48f884-6dad-4ed0-bea5-861c5b805dc0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:32:22.962813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:22.963809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:22.964761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:22.964761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:22.964761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:32:22.964761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:32:22.964761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:32:22.964761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:32:22.964761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:32:22.964761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:32:22.964761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 09:32:22.964761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:22.971946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 428/843] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:32:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:22.973644 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48f884-6dad-4ed0-bea5-861c5b805dc0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:23.029852 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:23.048948 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8289768-d118-4da3-96cc-036cecefd943 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:23.085622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d774e-87d8-4ebe-8ca5-faebc9d5f12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:23.086296 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d774e-87d8-4ebe-8ca5-faebc9d5f12d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:23.086613 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d774e-87d8-4ebe-8ca5-faebc9d5f12d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:23.086890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d774e-87d8-4ebe-8ca5-faebc9d5f12d None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:23.087602 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d774e-87d8-4ebe-8ca5-faebc9d5f12d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:23.087907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d774e-87d8-4ebe-8ca5-faebc9d5f12d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:23.088192 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48f884-6dad-4ed0-bea5-861c5b805dc0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:23.089283 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d774e-87d8-4ebe-8ca5-faebc9d5f12d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:23.102936 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 416/844] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:32:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:23.134539 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f469-0a1e-4c6e-9ea6-4790d846d84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:23.135586 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f469-0a1e-4c6e-9ea6-4790d846d84b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:23.136063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f469-0a1e-4c6e-9ea6-4790d846d84b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:23.136529 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f469-0a1e-4c6e-9ea6-4790d846d84b None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:23.137840 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65f469-0a1e-4c6e-9ea6-4790d846d84b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:23.138411 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65f469-0a1e-4c6e-9ea6-4790d846d84b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:23.140135 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65f469-0a1e-4c6e-9ea6-4790d846d84b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:23.164172 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 429/845] 10.222.0.45 () {56 vars in 1135 bytes} [Wed Jun 15 09:32:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:23.171679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d774e-87d8-4ebe-8ca5-faebc9d5f12d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:23.295236 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d774e-87d8-4ebe-8ca5-faebc9d5f12d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:23.336488 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b8585-396a-41c4-b93c-2268f12bfc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:23.337156 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b8585-396a-41c4-b93c-2268f12bfc80 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:23.337443 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b8585-396a-41c4-b93c-2268f12bfc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:23.337725 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b8585-396a-41c4-b93c-2268f12bfc80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:23.367346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:23.449981 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b8585-396a-41c4-b93c-2268f12bfc80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:23.452081 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b8585-396a-41c4-b93c-2268f12bfc80 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:23.585056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 417/846] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:32:23 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:32:23.591067 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f469-0a1e-4c6e-9ea6-4790d846d84b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:23.665830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:23.720620 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f469-0a1e-4c6e-9ea6-4790d846d84b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:23.763625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e78ab-507f-48b2-94eb-25928cbf667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:23.764827 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e78ab-507f-48b2-94eb-25928cbf667d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:23.765320 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e78ab-507f-48b2-94eb-25928cbf667d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:23.765799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e78ab-507f-48b2-94eb-25928cbf667d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:23.779268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e78ab-507f-48b2-94eb-25928cbf667d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:23.781119 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e78ab-507f-48b2-94eb-25928cbf667d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:23.800972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c19e78ab-507f-48b2-94eb-25928cbf667d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:23.800972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:23.800972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:23.800972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:23.800972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:23.800972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:23.800972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:23.800972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:23.800972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:23.800972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:23.800972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:23.800972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:23.800972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:23.800972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:23.800972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:23.801946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:23.802882 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:23.802882 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:23.802882 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:23.802882 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:23.805300 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 430/847] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:23.811425 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b8585-396a-41c4-b93c-2268f12bfc80 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:23.867703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:23.928497 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b8585-396a-41c4-b93c-2268f12bfc80 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:23.992158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4505cd-8e41-4262-abe3-1e7f924ddff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:23.993817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4505cd-8e41-4262-abe3-1e7f924ddff9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:23.994617 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4505cd-8e41-4262-abe3-1e7f924ddff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:23.995406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4505cd-8e41-4262-abe3-1e7f924ddff9 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:23.997094 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4505cd-8e41-4262-abe3-1e7f924ddff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:23.997954 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4505cd-8e41-4262-abe3-1e7f924ddff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:24.000969 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4505cd-8e41-4262-abe3-1e7f924ddff9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:24.017178 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 418/848] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:24.027348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e78ab-507f-48b2-94eb-25928cbf667d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:24.198647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e78ab-507f-48b2-94eb-25928cbf667d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:24.223412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:24.251878 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf05032-4ba5-4ace-be9c-748ed0fba2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:24.252853 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf05032-4ba5-4ace-be9c-748ed0fba2ec None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:24.253139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf05032-4ba5-4ace-be9c-748ed0fba2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:24.253422 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf05032-4ba5-4ace-be9c-748ed0fba2ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:24.265370 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf05032-4ba5-4ace-be9c-748ed0fba2ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:24.266919 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf05032-4ba5-4ace-be9c-748ed0fba2ec None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:24.282412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ddf05032-4ba5-4ace-be9c-748ed0fba2ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:24.282412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:24.282412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:24.282412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:24.282412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:24.282412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:24.282412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:24.282412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:24.282412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:24.282412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:24.282412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:24.282412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:24.282412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:24.282412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:24.282412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:24.284775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:24.286038 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:24.286038 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:24.286038 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:24.286038 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:24.286038 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:24.286038 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:24.286038 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:24.286038 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:24.286038 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 431/849] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:24.293059 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4505cd-8e41-4262-abe3-1e7f924ddff9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:24.332875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51b975-c758-4d38-9c16-bad3921d6551 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:24.333265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51b975-c758-4d38-9c16-bad3921d6551 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:24.333535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51b975-c758-4d38-9c16-bad3921d6551 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:24.335274 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 432/850] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:24.341502 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308511a-fea7-4a06-bafe-763ca4953af2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:24.341783 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308511a-fea7-4a06-bafe-763ca4953af2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:24.342051 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308511a-fea7-4a06-bafe-763ca4953af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:24.364614 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1308511a-fea7-4a06-bafe-763ca4953af2 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:24.366080 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1308511a-fea7-4a06-bafe-763ca4953af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:24.437026 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4505cd-8e41-4262-abe3-1e7f924ddff9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:24.448730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:24.480102 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb6578-4c3c-4a8e-b742-e404539b638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:24.480770 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb6578-4c3c-4a8e-b742-e404539b638b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:24.481064 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb6578-4c3c-4a8e-b742-e404539b638b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:24.481330 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb6578-4c3c-4a8e-b742-e404539b638b None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:24.482214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb6578-4c3c-4a8e-b742-e404539b638b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:24.482473 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb6578-4c3c-4a8e-b742-e404539b638b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:24.483095 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 433/851] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:32:24.483871 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb6578-4c3c-4a8e-b742-e404539b638b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:24.510096 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308511a-fea7-4a06-bafe-763ca4953af2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:24.516469 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 419/852] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:24.526050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb6578-4c3c-4a8e-b742-e404539b638b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:24.673856 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:24.679937 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308511a-fea7-4a06-bafe-763ca4953af2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:24.689964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb6578-4c3c-4a8e-b742-e404539b638b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:24.737318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce472b-d359-4ae9-8d8b-a5017cc67181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:24.739346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce472b-d359-4ae9-8d8b-a5017cc67181 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:24.739922 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce472b-d359-4ae9-8d8b-a5017cc67181 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:24.740311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce472b-d359-4ae9-8d8b-a5017cc67181 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:24.741692 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce472b-d359-4ae9-8d8b-a5017cc67181 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:24.744346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce472b-d359-4ae9-8d8b-a5017cc67181 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:24.747170 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311d22f-8b90-4703-807a-5a33dced5401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:24.748560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311d22f-8b90-4703-807a-5a33dced5401 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:24.749088 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311d22f-8b90-4703-807a-5a33dced5401 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:24.749938 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311d22f-8b90-4703-807a-5a33dced5401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:24.751419 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311d22f-8b90-4703-807a-5a33dced5401 None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=cdbfc031f967416e9a2c94bce3d28f66) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:24.752353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311d22f-8b90-4703-807a-5a33dced5401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:24.755044 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311d22f-8b90-4703-807a-5a33dced5401 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:24.763161 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 420/853] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:32:24 2022] GET /identity/v3/role_assignments?user.id=cdbfc031f967416e9a2c94bce3d28f66&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-37ce472b-d359-4ae9-8d8b-a5017cc67181 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:24.768859 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:24.769954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:24.770848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:24.770848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:24.770848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:24.770848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:24.770848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:24.770848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:24.770848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:24.770848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:24.770848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:24.770848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:24.770848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:24.770848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:24.770848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:24.770848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 09:32:24.770848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:24.771656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34911a58-2900-4eda-a2a4-fbfdbc2cf953 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:24.771656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34911a58-2900-4eda-a2a4-fbfdbc2cf953 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:24.771656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34911a58-2900-4eda-a2a4-fbfdbc2cf953 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:24.771850 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 434/854] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Jun 15 09:32:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:24.771918 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 421/855] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:32:24.778156 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34911a58-2900-4eda-a2a4-fbfdbc2cf953 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:24.779007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a712309-94b6-4cf3-8c57-4b2e86c4bcbc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:24.781257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a712309-94b6-4cf3-8c57-4b2e86c4bcbc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:24.781829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a712309-94b6-4cf3-8c57-4b2e86c4bcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:24.802056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8a712309-94b6-4cf3-8c57-4b2e86c4bcbc None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:24.803896 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8a712309-94b6-4cf3-8c57-4b2e86c4bcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:24.832502 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:24.890952 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 435/856] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:24.911435 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a712309-94b6-4cf3-8c57-4b2e86c4bcbc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:24.937147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34911a58-2900-4eda-a2a4-fbfdbc2cf953 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:24.986038 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d391e21-e8f7-463d-a838-a27772b78dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:24.986754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d391e21-e8f7-463d-a838-a27772b78dbf None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:24.987037 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d391e21-e8f7-463d-a838-a27772b78dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:24.987318 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d391e21-e8f7-463d-a838-a27772b78dbf None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:24.988035 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d391e21-e8f7-463d-a838-a27772b78dbf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:24.988405 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d391e21-e8f7-463d-a838-a27772b78dbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:24.990352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d391e21-e8f7-463d-a838-a27772b78dbf None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:24.997460 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 422/857] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Jun 15 09:32:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:25.003297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d391e21-e8f7-463d-a838-a27772b78dbf None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:25.026409 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:25.032785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a712309-94b6-4cf3-8c57-4b2e86c4bcbc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:25.075700 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a4a36-1616-44bf-aa4f-eb643ca27098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:25.076516 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a4a36-1616-44bf-aa4f-eb643ca27098 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:25.076797 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a4a36-1616-44bf-aa4f-eb643ca27098 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:25.077069 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a4a36-1616-44bf-aa4f-eb643ca27098 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:25.089869 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a4a36-1616-44bf-aa4f-eb643ca27098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e93a4a36-1616-44bf-aa4f-eb643ca27098 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:32:25.098548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:25.099600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:25.100454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:25.100454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:25.100454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:25.100454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:25.100454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:32:25.100454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:32:25.100454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:32:25.100454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:32:25.100454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:32:25.100454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:32:25.100454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:32:25.100454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:25.100454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 436/858] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:32:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:32:25.107237 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a4a36-1616-44bf-aa4f-eb643ca27098 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:25.125353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:25.133434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d391e21-e8f7-463d-a838-a27772b78dbf None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:25.218150 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64cbb8-4ad9-47f8-a86f-fd14384cef09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:25.220357 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64cbb8-4ad9-47f8-a86f-fd14384cef09 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:25.221155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64cbb8-4ad9-47f8-a86f-fd14384cef09 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:25.221899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64cbb8-4ad9-47f8-a86f-fd14384cef09 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:25.224459 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64cbb8-4ad9-47f8-a86f-fd14384cef09 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:25.225810 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64cbb8-4ad9-47f8-a86f-fd14384cef09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:25.230094 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64cbb8-4ad9-47f8-a86f-fd14384cef09 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:25.235750 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a4a36-1616-44bf-aa4f-eb643ca27098 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:25.242545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 423/859] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Jun 15 09:32:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:25.285584 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ac2c6-3491-411e-aa6f-175d86791015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:25.286171 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ac2c6-3491-411e-aa6f-175d86791015 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:25.286450 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ac2c6-3491-411e-aa6f-175d86791015 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:25.286750 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ac2c6-3491-411e-aa6f-175d86791015 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:25.287517 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ac2c6-3491-411e-aa6f-175d86791015 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:25.287823 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ac2c6-3491-411e-aa6f-175d86791015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:25.289240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ac2c6-3491-411e-aa6f-175d86791015 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:25.299685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 437/860] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:32:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:25.309395 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64cbb8-4ad9-47f8-a86f-fd14384cef09 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:25.471399 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64cbb8-4ad9-47f8-a86f-fd14384cef09 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:25.509776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02108df3-e9db-4b38-9a51-bb834adfc992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:25.510614 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02108df3-e9db-4b38-9a51-bb834adfc992 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:25.510901 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02108df3-e9db-4b38-9a51-bb834adfc992 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:25.511177 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02108df3-e9db-4b38-9a51-bb834adfc992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:25.523598 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02108df3-e9db-4b38-9a51-bb834adfc992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:25.525077 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02108df3-e9db-4b38-9a51-bb834adfc992 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:25.544970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-02108df3-e9db-4b38-9a51-bb834adfc992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:25.544970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:25.544970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:25.544970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:25.544970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:25.544970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:25.544970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:25.544970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:25.544970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:25.544970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:25.544970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:25.544970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:25.544970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:25.544970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:25.544970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:25.546690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:25.548166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:25.548166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:25.548166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:25.548166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:25.548166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 424/861] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:25.552702 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ac2c6-3491-411e-aa6f-175d86791015 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:25.574039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:25.671429 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ac2c6-3491-411e-aa6f-175d86791015 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:25.709755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f263dcf-fd31-409e-a7d9-16d22307740b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:25.711171 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f263dcf-fd31-409e-a7d9-16d22307740b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:25.711639 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f263dcf-fd31-409e-a7d9-16d22307740b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:25.712062 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f263dcf-fd31-409e-a7d9-16d22307740b None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:25.713026 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f263dcf-fd31-409e-a7d9-16d22307740b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:25.713486 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f263dcf-fd31-409e-a7d9-16d22307740b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:25.715172 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f263dcf-fd31-409e-a7d9-16d22307740b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:25.729781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 438/862] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:25.735246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02108df3-e9db-4b38-9a51-bb834adfc992 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:25.752380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:25.849416 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02108df3-e9db-4b38-9a51-bb834adfc992 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:25.891841 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a792d-78b4-4f92-b47b-91a1190da65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:25.892699 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a792d-78b4-4f92-b47b-91a1190da65d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:25.892985 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a792d-78b4-4f92-b47b-91a1190da65d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:25.893269 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a792d-78b4-4f92-b47b-91a1190da65d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:25.902334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a792d-78b4-4f92-b47b-91a1190da65d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:25.903864 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a792d-78b4-4f92-b47b-91a1190da65d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-6d6a792d-78b4-4f92-b47b-91a1190da65d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:32:25.920310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:25.921310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:25.922288 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:25.922288 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:25.922288 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:32:25.922288 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:32:25.922288 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:32:25.922288 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:32:25.922288 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:32:25.922288 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:32:25.922288 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 09:32:25.922288 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:25.922288 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 425/863] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Jun 15 09:32:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:25.928249 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f263dcf-fd31-409e-a7d9-16d22307740b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:26.019882 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:26.073332 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f263dcf-fd31-409e-a7d9-16d22307740b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:26.147446 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c875d-8666-40dc-a6e6-ff4a136dbe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:26.148579 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c875d-8666-40dc-a6e6-ff4a136dbe58 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:26.149096 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c875d-8666-40dc-a6e6-ff4a136dbe58 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:26.149585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c875d-8666-40dc-a6e6-ff4a136dbe58 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:26.151296 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c875d-8666-40dc-a6e6-ff4a136dbe58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:26.151860 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c875d-8666-40dc-a6e6-ff4a136dbe58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:26.154773 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c875d-8666-40dc-a6e6-ff4a136dbe58 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:26.192765 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 439/864] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Jun 15 09:32:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:26.198006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a792d-78b4-4f92-b47b-91a1190da65d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:26.278885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:26.315003 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a792d-78b4-4f92-b47b-91a1190da65d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:26.356858 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92783d-5964-4a20-b678-5492bc84913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:26.357540 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92783d-5964-4a20-b678-5492bc84913c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:26.357828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92783d-5964-4a20-b678-5492bc84913c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:26.358107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92783d-5964-4a20-b678-5492bc84913c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:26.436074 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e0eae-5521-4648-9131-b29601d90455 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:26.436402 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92783d-5964-4a20-b678-5492bc84913c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:26.436619 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e0eae-5521-4648-9131-b29601d90455 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:26.437043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e0eae-5521-4648-9131-b29601d90455 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:26.437845 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92783d-5964-4a20-b678-5492bc84913c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:26.445835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 440/865] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:32:26.448576 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a36973-2503-43fb-baa0-222b85fc3471 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:26.449080 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a36973-2503-43fb-baa0-222b85fc3471 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:26.449567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a36973-2503-43fb-baa0-222b85fc3471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:26.478475 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-44a36973-2503-43fb-baa0-222b85fc3471 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:26.480108 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-44a36973-2503-43fb-baa0-222b85fc3471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:26.513678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:26.553484 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 426/866] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:32:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:32:26.554629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92783d-5964-4a20-b678-5492bc84913c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:26.637920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 441/867] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:32:26.663730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92783d-5964-4a20-b678-5492bc84913c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:26.680583 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a36973-2503-43fb-baa0-222b85fc3471 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:26.702336 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e572988-5fe2-4bbd-965e-86a1d9854f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:26.703083 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e572988-5fe2-4bbd-965e-86a1d9854f2c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:26.703366 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e572988-5fe2-4bbd-965e-86a1d9854f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:26.703643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e572988-5fe2-4bbd-965e-86a1d9854f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:26.716321 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e572988-5fe2-4bbd-965e-86a1d9854f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:26.717908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e572988-5fe2-4bbd-965e-86a1d9854f2c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:26.737759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7e572988-5fe2-4bbd-965e-86a1d9854f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:26.737759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:26.737759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:26.737759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:26.737759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:26.737759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:26.737759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:26.737759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:26.737759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:26.737759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:26.737759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:26.737759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:26.737759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:26.737759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:26.737759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:26.740217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:26.742366 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:26.742366 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:26.742366 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:26.742366 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:26.742366 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 427/868] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:32:26.745328 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e572988-5fe2-4bbd-965e-86a1d9854f2c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:26.799865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:26.826069 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:26.912426 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a36973-2503-43fb-baa0-222b85fc3471 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:26.975070 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e572988-5fe2-4bbd-965e-86a1d9854f2c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:26.993627 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33928139-c2a0-40ac-878a-3d5e2fa46bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:26.994827 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33928139-c2a0-40ac-878a-3d5e2fa46bc0 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:26.995332 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33928139-c2a0-40ac-878a-3d5e2fa46bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:26.995837 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33928139-c2a0-40ac-878a-3d5e2fa46bc0 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:26.997221 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33928139-c2a0-40ac-878a-3d5e2fa46bc0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:27.000579 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33928139-c2a0-40ac-878a-3d5e2fa46bc0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:27.031148 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 442/869] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Jun 15 09:32:26 2022] POST /identity/v3/services => generated 251 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:32:27.069991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab2dad-fc5b-4e50-aa72-c7503aef279a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:27.071220 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab2dad-fc5b-4e50-aa72-c7503aef279a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:27.071736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab2dad-fc5b-4e50-aa72-c7503aef279a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:27.072240 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab2dad-fc5b-4e50-aa72-c7503aef279a None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:27.073723 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab2dad-fc5b-4e50-aa72-c7503aef279a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:27.074300 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab2dad-fc5b-4e50-aa72-c7503aef279a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:27.077124 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab2dad-fc5b-4e50-aa72-c7503aef279a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:27.102572 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 428/870] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:27.111711 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33928139-c2a0-40ac-878a-3d5e2fa46bc0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:27.248896 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33928139-c2a0-40ac-878a-3d5e2fa46bc0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:27.290180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:27.312156 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353d81e-828f-4f42-87be-5ecfd61d2cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:27.314465 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353d81e-828f-4f42-87be-5ecfd61d2cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:27.314465 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353d81e-828f-4f42-87be-5ecfd61d2cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:27.314843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353d81e-828f-4f42-87be-5ecfd61d2cd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:27.329878 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353d81e-828f-4f42-87be-5ecfd61d2cd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:27.332783 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353d81e-828f-4f42-87be-5ecfd61d2cd1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:27.362177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d353d81e-828f-4f42-87be-5ecfd61d2cd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:27.362177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:27.362177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:27.362177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:27.362177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:27.362177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:27.362177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:27.362177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:27.362177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:27.362177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:27.362177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:27.362177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:27.362177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:27.362177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:27.362177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:27.364595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:27.367151 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:27.367151 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:27.367151 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:27.367151 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:27.367151 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:27.367151 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:27.367151 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:27.367151 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:27.367151 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 443/871] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:27.371799 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab2dad-fc5b-4e50-aa72-c7503aef279a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:27.420708 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5e40e-090b-45fc-aeb5-fab4d1e3b77f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:27.421209 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5e40e-090b-45fc-aeb5-fab4d1e3b77f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:27.421717 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5e40e-090b-45fc-aeb5-fab4d1e3b77f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:27.426542 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 444/872] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:27.431353 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf36462-54fe-4a26-b131-0a340b5a30e0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:27.431611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf36462-54fe-4a26-b131-0a340b5a30e0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:27.432030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf36462-54fe-4a26-b131-0a340b5a30e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:27.451806 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ecf36462-54fe-4a26-b131-0a340b5a30e0 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:27.453149 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ecf36462-54fe-4a26-b131-0a340b5a30e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:27.556892 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:27.578909 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab2dad-fc5b-4e50-aa72-c7503aef279a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:27.598790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 445/873] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:32:27.618422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a4814-41af-4283-a999-f8f964b93b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:27.619139 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a4814-41af-4283-a999-f8f964b93b06 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:27.619430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a4814-41af-4283-a999-f8f964b93b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:27.619709 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a4814-41af-4283-a999-f8f964b93b06 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:27.620527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a4814-41af-4283-a999-f8f964b93b06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:27.620879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a4814-41af-4283-a999-f8f964b93b06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:27.622353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a4814-41af-4283-a999-f8f964b93b06 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:27.637211 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 429/874] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:27.640460 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf36462-54fe-4a26-b131-0a340b5a30e0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:27.642618 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a4814-41af-4283-a999-f8f964b93b06 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:27.761340 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a4814-41af-4283-a999-f8f964b93b06 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:27.803524 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d93e2-c0f9-44f8-aaea-1dd5a33e4ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:27.804681 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d93e2-c0f9-44f8-aaea-1dd5a33e4ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:27.805169 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d93e2-c0f9-44f8-aaea-1dd5a33e4ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:27.805633 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d93e2-c0f9-44f8-aaea-1dd5a33e4ca9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:27.806747 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d93e2-c0f9-44f8-aaea-1dd5a33e4ca9 None admin] RBAC: Adding query filter params (role.id=0ff0d3dcb5e448c3abc2470461490795, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=57632a25fe1f4b18b75e9774e87d8ffb) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:27.807297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d93e2-c0f9-44f8-aaea-1dd5a33e4ca9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:27.809091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d93e2-c0f9-44f8-aaea-1dd5a33e4ca9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:27.816717 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 430/875] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:32:27 2022] GET /identity/v3/role_assignments?user.id=57632a25fe1f4b18b75e9774e87d8ffb&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=0ff0d3dcb5e448c3abc2470461490795 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:27.862042 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf36462-54fe-4a26-b131-0a340b5a30e0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:27.896153 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:27.940364 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21e3aa-e14f-47dc-8e57-bdfb266764ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:27.942432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21e3aa-e14f-47dc-8e57-bdfb266764ed None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:27.943271 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21e3aa-e14f-47dc-8e57-bdfb266764ed None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:27.944016 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21e3aa-e14f-47dc-8e57-bdfb266764ed None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:27.945613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21e3aa-e14f-47dc-8e57-bdfb266764ed None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:27.948629 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21e3aa-e14f-47dc-8e57-bdfb266764ed None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:27.956266 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85db1-bbc3-46f6-a6b7-11cc9ad4cbfa None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:27.958019 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85db1-bbc3-46f6-a6b7-11cc9ad4cbfa None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:27.958836 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85db1-bbc3-46f6-a6b7-11cc9ad4cbfa None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:27.962049 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 431/876] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:27.970953 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3b930-e00d-4645-8f8c-d51272bd13ad None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:27.971250 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3b930-e00d-4645-8f8c-d51272bd13ad None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:27.971622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3b930-e00d-4645-8f8c-d51272bd13ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4f21e3aa-e14f-47dc-8e57-bdfb266764ed None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:27.978400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:27.980464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:27.982378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:27.982378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:27.982378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:27.982378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:27.982378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:27.982378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:27.982378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:27.982378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:27.982378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:27.982378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:27.982378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:27.982378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:27.982378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 09:32:27.982378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:27.987258 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 446/877] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Jun 15 09:32:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:27.987794 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:27.995835 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-43a3b930-e00d-4645-8f8c-d51272bd13ad None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:27.997572 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-43a3b930-e00d-4645-8f8c-d51272bd13ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:27.998253 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21e3aa-e14f-47dc-8e57-bdfb266764ed None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:28.118592 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 432/878] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:28.145773 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3b930-e00d-4645-8f8c-d51272bd13ad None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:28.191584 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21e3aa-e14f-47dc-8e57-bdfb266764ed None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:28.253023 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76bb02-6583-4921-8592-ebe9c776afa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:28.254703 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76bb02-6583-4921-8592-ebe9c776afa5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:28.255175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76bb02-6583-4921-8592-ebe9c776afa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:28.255632 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76bb02-6583-4921-8592-ebe9c776afa5 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:28.256860 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76bb02-6583-4921-8592-ebe9c776afa5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:28.257395 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76bb02-6583-4921-8592-ebe9c776afa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:28.259873 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76bb02-6583-4921-8592-ebe9c776afa5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:28.269973 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 447/879] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Jun 15 09:32:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:28.277008 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76bb02-6583-4921-8592-ebe9c776afa5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:28.355584 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3b930-e00d-4645-8f8c-d51272bd13ad None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:28.369198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:28.422628 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c08bf4-cb9f-4aae-bf7d-931f55d7b924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:28.424113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c08bf4-cb9f-4aae-bf7d-931f55d7b924 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:28.424775 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c08bf4-cb9f-4aae-bf7d-931f55d7b924 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:28.425465 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c08bf4-cb9f-4aae-bf7d-931f55d7b924 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:28.427114 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c08bf4-cb9f-4aae-bf7d-931f55d7b924 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:28.429963 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c08bf4-cb9f-4aae-bf7d-931f55d7b924 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:28.434392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:28.464218 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 433/880] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Jun 15 09:32:28 2022] POST /identity/v3/services => generated 269 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 09:32:28.493928 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76bb02-6583-4921-8592-ebe9c776afa5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:28.580756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069d8db-5892-4083-8f6a-199bd96ca3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:28.582465 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069d8db-5892-4083-8f6a-199bd96ca3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:28.583036 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069d8db-5892-4083-8f6a-199bd96ca3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:28.583528 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069d8db-5892-4083-8f6a-199bd96ca3b7 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:28.584885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069d8db-5892-4083-8f6a-199bd96ca3b7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:28.585428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069d8db-5892-4083-8f6a-199bd96ca3b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:28.588113 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069d8db-5892-4083-8f6a-199bd96ca3b7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:28.597726 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 448/881] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Jun 15 09:32:28 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:30.363970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee05b60-cda8-4f8c-aea8-7c5110c382b9 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:30.365046 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee05b60-cda8-4f8c-aea8-7c5110c382b9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:30.365555 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee05b60-cda8-4f8c-aea8-7c5110c382b9 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:30.367495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 434/882] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:30.373484 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9962d-4975-40df-939b-62c0d935c7d0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:30.374414 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9962d-4975-40df-939b-62c0d935c7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:30.374946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9962d-4975-40df-939b-62c0d935c7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:30.394888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1cc9962d-4975-40df-939b-62c0d935c7d0 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:30.396542 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1cc9962d-4975-40df-939b-62c0d935c7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:30.482997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 449/883] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:32:30.504422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee05b60-cda8-4f8c-aea8-7c5110c382b9 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:30.682263 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dac7a7-46b1-426e-adfe-387fe86b7b8d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:30.682556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dac7a7-46b1-426e-adfe-387fe86b7b8d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:30.682724 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dac7a7-46b1-426e-adfe-387fe86b7b8d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:30.684397 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 450/884] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:30.687832 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee05b60-cda8-4f8c-aea8-7c5110c382b9 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:30.690092 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab54094-a381-40bd-9def-ba8236ad6e3c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:30.690383 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab54094-a381-40bd-9def-ba8236ad6e3c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:30.691161 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab54094-a381-40bd-9def-ba8236ad6e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:30.712717 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1ab54094-a381-40bd-9def-ba8236ad6e3c None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:30.715292 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1ab54094-a381-40bd-9def-ba8236ad6e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:30.752853 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:30.756659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c73217-e43c-4331-ad2a-5bd258674ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:30.758187 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c73217-e43c-4331-ad2a-5bd258674ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:30.758726 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c73217-e43c-4331-ad2a-5bd258674ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:30.760439 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c73217-e43c-4331-ad2a-5bd258674ac0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:30.786765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c73217-e43c-4331-ad2a-5bd258674ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:32:30.805683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 451/885] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-92c73217-e43c-4331-ad2a-5bd258674ac0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:32:30.805908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:30.806899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:30.807812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:30.807812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:30.807812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:30.807812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:30.807812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:32:30.807812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:32:30.807812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:32:30.807812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:32:30.807812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:32:30.807812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:32:30.807812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 09:32:30.807812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:30.808515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 435/886] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Jun 15 09:32:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:32:30.816462 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab54094-a381-40bd-9def-ba8236ad6e3c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:30.828311 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616debe4-f0f1-469b-a1c0-50d55147acbc None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:30.828786 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616debe4-f0f1-469b-a1c0-50d55147acbc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:30.828959 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616debe4-f0f1-469b-a1c0-50d55147acbc None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:30.831158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 436/887] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:32:30.832425 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616debe4-f0f1-469b-a1c0-50d55147acbc None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:30.902310 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:30.943476 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab54094-a381-40bd-9def-ba8236ad6e3c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:30.982555 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669e517-5146-46dd-b86c-340337bfe26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:30.983251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669e517-5146-46dd-b86c-340337bfe26a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:30.983537 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669e517-5146-46dd-b86c-340337bfe26a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:30.983911 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669e517-5146-46dd-b86c-340337bfe26a None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:30.984681 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669e517-5146-46dd-b86c-340337bfe26a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:30.984988 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669e517-5146-46dd-b86c-340337bfe26a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:30.986361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669e517-5146-46dd-b86c-340337bfe26a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:30.987153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616debe4-f0f1-469b-a1c0-50d55147acbc None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:30.999997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 452/888] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Jun 15 09:32:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:30.999997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99795436-1c42-4b37-8dbf-230a83a6091e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:30.999997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99795436-1c42-4b37-8dbf-230a83a6091e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:30.999997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99795436-1c42-4b37-8dbf-230a83a6091e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:31.015345 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-99795436-1c42-4b37-8dbf-230a83a6091e None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:31.016568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-99795436-1c42-4b37-8dbf-230a83a6091e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:31.042051 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:31.048556 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406bd6c-0172-4469-8d70-5144093047d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:31.049463 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406bd6c-0172-4469-8d70-5144093047d5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:31.050456 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406bd6c-0172-4469-8d70-5144093047d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:31.050456 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406bd6c-0172-4469-8d70-5144093047d5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:31.051088 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406bd6c-0172-4469-8d70-5144093047d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:31.052482 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406bd6c-0172-4469-8d70-5144093047d5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-c406bd6c-0172-4469-8d70-5144093047d5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:31.066331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:31.067568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:31.068424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:31.068424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:31.068424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:31.068424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:31.068424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:31.068424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:31.068424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:31.068424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:31.068424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:31.068424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:31.068424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:31.068424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:31.068424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:31.068424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 09:32:31.068424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:31.072901 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 437/889] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Jun 15 09:32:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:31.073419 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406bd6c-0172-4469-8d70-5144093047d5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:31.114918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 453/890] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:31.115936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99795436-1c42-4b37-8dbf-230a83a6091e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:31.246897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406bd6c-0172-4469-8d70-5144093047d5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:31.258437 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99795436-1c42-4b37-8dbf-230a83a6091e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:31.269768 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:31.294184 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb3f8e-398a-435b-b188-38ca91d32960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:31.295047 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb3f8e-398a-435b-b188-38ca91d32960 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:31.295353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb3f8e-398a-435b-b188-38ca91d32960 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:31.295624 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb3f8e-398a-435b-b188-38ca91d32960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:31.305777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342d32c-0f13-4f62-b830-7b22b0e0a7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:31.306467 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342d32c-0f13-4f62-b830-7b22b0e0a7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:31.306781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342d32c-0f13-4f62-b830-7b22b0e0a7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:31.307061 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342d32c-0f13-4f62-b830-7b22b0e0a7d3 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:31.307764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342d32c-0f13-4f62-b830-7b22b0e0a7d3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:31.308067 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342d32c-0f13-4f62-b830-7b22b0e0a7d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:31.309309 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb3f8e-398a-435b-b188-38ca91d32960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:31.309492 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342d32c-0f13-4f62-b830-7b22b0e0a7d3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:31.310807 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb3f8e-398a-435b-b188-38ca91d32960 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:31.316206 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 454/891] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Jun 15 09:32:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:31.316825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342d32c-0f13-4f62-b830-7b22b0e0a7d3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:31.336944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f9fb3f8e-398a-435b-b188-38ca91d32960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:31.336944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:31.336944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:31.336944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:31.336944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:31.336944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:31.336944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:31.336944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:31.336944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:31.336944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:31.336944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:31.336944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:31.336944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:31.336944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:31.336944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:31.338860 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:31.340676 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:31.340676 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:31.340676 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:31.340676 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:31.340676 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 438/892] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:31.340676 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb3f8e-398a-435b-b188-38ca91d32960 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:31.346229 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:31.471295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb3f8e-398a-435b-b188-38ca91d32960 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:31.489099 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342d32c-0f13-4f62-b830-7b22b0e0a7d3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:31.513363 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747585e-0cdd-4685-91cc-487e64fa9380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:31.514137 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747585e-0cdd-4685-91cc-487e64fa9380 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:31.514425 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747585e-0cdd-4685-91cc-487e64fa9380 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:31.514733 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747585e-0cdd-4685-91cc-487e64fa9380 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:31.515955 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747585e-0cdd-4685-91cc-487e64fa9380 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:31.516274 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747585e-0cdd-4685-91cc-487e64fa9380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:31.520990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747585e-0cdd-4685-91cc-487e64fa9380 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:31.530574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 439/893] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Jun 15 09:32:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:31.530574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747585e-0cdd-4685-91cc-487e64fa9380 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:31.553777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e88ac8-0e6f-4f9d-8189-b67ddc35cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:31.554965 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e88ac8-0e6f-4f9d-8189-b67ddc35cc95 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:31.555273 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e88ac8-0e6f-4f9d-8189-b67ddc35cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:31.555522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e88ac8-0e6f-4f9d-8189-b67ddc35cc95 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:31.556192 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e88ac8-0e6f-4f9d-8189-b67ddc35cc95 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:31.558149 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e88ac8-0e6f-4f9d-8189-b67ddc35cc95 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-23e88ac8-0e6f-4f9d-8189-b67ddc35cc95 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:31.572304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:31.574311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:31.576114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:31.576114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:31.576114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:31.576114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:31.576114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:31.576114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:31.576114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:31.576114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:31.576114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:31.576114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:31.576114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:31.576114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:31.576114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 09:32:31.576114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:31.577587 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:31.577727 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 455/894] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:32:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:31.577727 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e88ac8-0e6f-4f9d-8189-b67ddc35cc95 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:31.665168 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747585e-0cdd-4685-91cc-487e64fa9380 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:31.692351 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:31.712681 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9f7cf-1383-49da-80d4-4da6c5f294ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:31.713378 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9f7cf-1383-49da-80d4-4da6c5f294ee None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:31.713663 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9f7cf-1383-49da-80d4-4da6c5f294ee None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:31.713941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9f7cf-1383-49da-80d4-4da6c5f294ee None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:31.714743 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9f7cf-1383-49da-80d4-4da6c5f294ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:31.715067 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9f7cf-1383-49da-80d4-4da6c5f294ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:31.716537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9f7cf-1383-49da-80d4-4da6c5f294ee None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:31.722894 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e88ac8-0e6f-4f9d-8189-b67ddc35cc95 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:31.735086 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 440/895] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:31.738262 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9f7cf-1383-49da-80d4-4da6c5f294ee None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:31.785199 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297c104-e7ff-41bf-8550-e850ecc6ab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:31.786004 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297c104-e7ff-41bf-8550-e850ecc6ab3c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:31.786378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297c104-e7ff-41bf-8550-e850ecc6ab3c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:31.786754 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297c104-e7ff-41bf-8550-e850ecc6ab3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:31.787860 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297c104-e7ff-41bf-8550-e850ecc6ab3c None admin] RBAC: Adding query filter params (interface=public, service_id=6a8fb585b29c4996bb3aaddc2874f205, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:31.788313 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297c104-e7ff-41bf-8550-e850ecc6ab3c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:31.789995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297c104-e7ff-41bf-8550-e850ecc6ab3c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:31.796913 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 456/896] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Jun 15 09:32:31 2022] GET /identity/v3/endpoints?service_id=6a8fb585b29c4996bb3aaddc2874f205&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:31.798376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297c104-e7ff-41bf-8550-e850ecc6ab3c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:31.886444 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:31.895331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9f7cf-1383-49da-80d4-4da6c5f294ee None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:31.936707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da5e5a-5613-4804-ac75-b970dd5af1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:31.937761 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da5e5a-5613-4804-ac75-b970dd5af1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:31.938245 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da5e5a-5613-4804-ac75-b970dd5af1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:31.938758 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da5e5a-5613-4804-ac75-b970dd5af1f6 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:31.939987 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da5e5a-5613-4804-ac75-b970dd5af1f6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:31.940589 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da5e5a-5613-4804-ac75-b970dd5af1f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:31.943545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da5e5a-5613-4804-ac75-b970dd5af1f6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:31.949663 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297c104-e7ff-41bf-8550-e850ecc6ab3c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:31.951739 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 441/897] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:32:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:31.953085 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da5e5a-5613-4804-ac75-b970dd5af1f6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:32.015101 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194b4b5-9009-456a-a524-2d8c8d215c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:32.016817 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194b4b5-9009-456a-a524-2d8c8d215c42 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:32.017596 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194b4b5-9009-456a-a524-2d8c8d215c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:32.018356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194b4b5-9009-456a-a524-2d8c8d215c42 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:32.033831 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194b4b5-9009-456a-a524-2d8c8d215c42 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:32.037010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194b4b5-9009-456a-a524-2d8c8d215c42 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2194b4b5-9009-456a-a524-2d8c8d215c42 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:32:32.065242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:32.067824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:32.070830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:32.070830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:32.070830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:32:32.070830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:32:32.070830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:32:32.070830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:32:32.070830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:32:32.070830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:32:32.070830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 09:32:32.070830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:32.070830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 457/898] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Jun 15 09:32:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:32.070830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194b4b5-9009-456a-a524-2d8c8d215c42 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:32.083473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:32.111708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da5e5a-5613-4804-ac75-b970dd5af1f6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:32.170931 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51200216-4727-4cfe-9404-c024f70ae0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:32.171997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51200216-4727-4cfe-9404-c024f70ae0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:32.172455 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51200216-4727-4cfe-9404-c024f70ae0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:32.173047 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51200216-4727-4cfe-9404-c024f70ae0a4 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:32.174231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51200216-4727-4cfe-9404-c024f70ae0a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:32.176557 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51200216-4727-4cfe-9404-c024f70ae0a4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:32.198706 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 442/899] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Jun 15 09:32:31 2022] GET /identity/v3/services => generated 1268 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 09:32:32.198706 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51200216-4727-4cfe-9404-c024f70ae0a4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:32.247040 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194b4b5-9009-456a-a524-2d8c8d215c42 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:32.250947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:32.321147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94be64d-e3da-4a87-8026-4957bd98655e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:32.322179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94be64d-e3da-4a87-8026-4957bd98655e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:32.322685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94be64d-e3da-4a87-8026-4957bd98655e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:32.323141 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94be64d-e3da-4a87-8026-4957bd98655e None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:32.324790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94be64d-e3da-4a87-8026-4957bd98655e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:32.325305 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94be64d-e3da-4a87-8026-4957bd98655e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:32.327916 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94be64d-e3da-4a87-8026-4957bd98655e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:32.339316 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 458/900] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:32:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:32.346561 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94be64d-e3da-4a87-8026-4957bd98655e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:32.398666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51200216-4727-4cfe-9404-c024f70ae0a4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:32.437691 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:32.471608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d35dd-b0ea-4491-a6e2-fa8e3878947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:32.473404 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d35dd-b0ea-4491-a6e2-fa8e3878947b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:32.473859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d35dd-b0ea-4491-a6e2-fa8e3878947b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:32.474317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d35dd-b0ea-4491-a6e2-fa8e3878947b None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:32.476218 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d35dd-b0ea-4491-a6e2-fa8e3878947b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:32.476730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d35dd-b0ea-4491-a6e2-fa8e3878947b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:32.480292 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d35dd-b0ea-4491-a6e2-fa8e3878947b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:32.492318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94be64d-e3da-4a87-8026-4957bd98655e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:32.519199 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 443/901] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Jun 15 09:32:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:32.523976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985034f-013b-4972-bdd2-8e458c7a5685 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:32.523976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985034f-013b-4972-bdd2-8e458c7a5685 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:32.523976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985034f-013b-4972-bdd2-8e458c7a5685 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:32.524708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 444/902] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:32.526132 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985034f-013b-4972-bdd2-8e458c7a5685 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:32.558041 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c062b0-015d-4f64-ae53-acb21ec1be5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:32.559250 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c062b0-015d-4f64-ae53-acb21ec1be5d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:32.559773 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c062b0-015d-4f64-ae53-acb21ec1be5d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:32.560284 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c062b0-015d-4f64-ae53-acb21ec1be5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:32.561874 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c062b0-015d-4f64-ae53-acb21ec1be5d None admin] RBAC: Adding query filter params (interface=public, service_id=6c7689b9b3a14344aeff073648c247bb, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:32.562454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c062b0-015d-4f64-ae53-acb21ec1be5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:32.565187 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c062b0-015d-4f64-ae53-acb21ec1be5d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:32.578852 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 459/903] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Jun 15 09:32:32 2022] GET /identity/v3/endpoints?service_id=6c7689b9b3a14344aeff073648c247bb&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:32.582668 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feeb9e-9d30-4b59-aedf-2a71c410fc00 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:32.583955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feeb9e-9d30-4b59-aedf-2a71c410fc00 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:32.584411 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feeb9e-9d30-4b59-aedf-2a71c410fc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:32.614852 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a7feeb9e-9d30-4b59-aedf-2a71c410fc00 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:32.616563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a7feeb9e-9d30-4b59-aedf-2a71c410fc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:32.686285 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:32.710864 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 460/904] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:32.711851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feeb9e-9d30-4b59-aedf-2a71c410fc00 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:32.740222 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985034f-013b-4972-bdd2-8e458c7a5685 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:32.790828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4424a9-e731-4b90-a488-5f39094bd2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:32.791501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4424a9-e731-4b90-a488-5f39094bd2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:32.791782 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4424a9-e731-4b90-a488-5f39094bd2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:32.792055 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4424a9-e731-4b90-a488-5f39094bd2e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:32.802276 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:32.853372 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feeb9e-9d30-4b59-aedf-2a71c410fc00 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:32.886532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4424a9-e731-4b90-a488-5f39094bd2e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:32.888443 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4424a9-e731-4b90-a488-5f39094bd2e5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:32.912587 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381a646-9a83-4310-be02-af872a693ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:32.913942 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381a646-9a83-4310-be02-af872a693ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:32.914338 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381a646-9a83-4310-be02-af872a693ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:32.914773 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381a646-9a83-4310-be02-af872a693ed5 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:32.915868 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381a646-9a83-4310-be02-af872a693ed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:32.917729 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381a646-9a83-4310-be02-af872a693ed5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:32.934768 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 461/905] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Jun 15 09:32:32 2022] GET /identity/v3/services => generated 1268 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 09:32:32.934768 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381a646-9a83-4310-be02-af872a693ed5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:33.054234 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:33.106661 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 445/906] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:32:32 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:32:33.114789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4424a9-e731-4b90-a488-5f39094bd2e5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:33.172397 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381a646-9a83-4310-be02-af872a693ed5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:33.231369 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:33.248745 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e32b71-9cce-438f-944d-ef78360c4c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:33.250260 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e32b71-9cce-438f-944d-ef78360c4c5a None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:33.251005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e32b71-9cce-438f-944d-ef78360c4c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:33.251697 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e32b71-9cce-438f-944d-ef78360c4c5a None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:33.252994 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e32b71-9cce-438f-944d-ef78360c4c5a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:33.255722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e32b71-9cce-438f-944d-ef78360c4c5a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:33.281828 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 462/907] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Jun 15 09:32:32 2022] POST /identity/v3/services => generated 241 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:32:33.313120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4424a9-e731-4b90-a488-5f39094bd2e5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:33.400502 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f8cd7-654f-484f-a810-2bdfa279def6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:33.401750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8cd7-654f-484f-a810-2bdfa279def6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:33.402227 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8cd7-654f-484f-a810-2bdfa279def6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:33.402739 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8cd7-654f-484f-a810-2bdfa279def6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:33.424286 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f8cd7-654f-484f-a810-2bdfa279def6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:33.427128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f8cd7-654f-484f-a810-2bdfa279def6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:33.462759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-663f8cd7-654f-484f-a810-2bdfa279def6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:33.462759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:33.462759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:33.462759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:33.462759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:33.462759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:33.462759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:33.462759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:33.462759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:33.462759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:33.462759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:33.462759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:33.462759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:33.462759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:33.462759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:33.464494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:33.465862 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:33.465862 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:33.465862 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:33.465862 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:33.465862 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 446/908] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:33.473857 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e32b71-9cce-438f-944d-ef78360c4c5a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:33.673557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e32b71-9cce-438f-944d-ef78360c4c5a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:33.742390 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0383906-2427-4dbd-b27f-9d2881035433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:33.744082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0383906-2427-4dbd-b27f-9d2881035433 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:33.744883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0383906-2427-4dbd-b27f-9d2881035433 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:33.745657 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0383906-2427-4dbd-b27f-9d2881035433 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:33.747331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0383906-2427-4dbd-b27f-9d2881035433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:33.748208 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0383906-2427-4dbd-b27f-9d2881035433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:33.751145 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0383906-2427-4dbd-b27f-9d2881035433 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:33.775599 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 463/909] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:33.783727 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f8cd7-654f-484f-a810-2bdfa279def6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:33.838761 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:33.974943 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f8cd7-654f-484f-a810-2bdfa279def6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:34.040346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ea401-c361-4213-9f05-060e233f2a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:34.041672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ea401-c361-4213-9f05-060e233f2a61 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:34.042193 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ea401-c361-4213-9f05-060e233f2a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:34.042618 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ea401-c361-4213-9f05-060e233f2a61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:34.057259 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ea401-c361-4213-9f05-060e233f2a61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:34.060090 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ea401-c361-4213-9f05-060e233f2a61 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:34.088906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-691ea401-c361-4213-9f05-060e233f2a61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:34.088906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:34.088906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:34.088906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:34.088906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:34.088906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:34.088906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:34.088906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:34.088906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:34.088906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:34.088906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:34.088906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:34.088906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:34.088906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:34.088906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:34.091197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:34.094878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:34.094878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:34.094878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:34.094878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:34.094878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:34.094878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:34.094878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:34.094878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:34.094878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 447/910] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:34.103677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0383906-2427-4dbd-b27f-9d2881035433 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:34.195985 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:34.299494 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0383906-2427-4dbd-b27f-9d2881035433 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:34.364590 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243410e0-ee23-45b6-be30-217f87852439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:34.365747 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243410e0-ee23-45b6-be30-217f87852439 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:34.366252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243410e0-ee23-45b6-be30-217f87852439 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:34.366776 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243410e0-ee23-45b6-be30-217f87852439 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:34.368204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243410e0-ee23-45b6-be30-217f87852439 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:34.368766 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243410e0-ee23-45b6-be30-217f87852439 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:34.371387 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243410e0-ee23-45b6-be30-217f87852439 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:34.397367 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 464/911] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:34.406802 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ea401-c361-4213-9f05-060e233f2a61 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:34.594960 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:34.613096 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ea401-c361-4213-9f05-060e233f2a61 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:34.678901 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e79f06-298d-455a-81b0-b8f7bdd1708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:34.680019 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e79f06-298d-455a-81b0-b8f7bdd1708c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:34.680511 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e79f06-298d-455a-81b0-b8f7bdd1708c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:34.680999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e79f06-298d-455a-81b0-b8f7bdd1708c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:34.682635 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e79f06-298d-455a-81b0-b8f7bdd1708c None admin] RBAC: Adding query filter params (role.id=f81068136c064fa4a26cdb5606d27c4e, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=57632a25fe1f4b18b75e9774e87d8ffb) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:34.683154 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e79f06-298d-455a-81b0-b8f7bdd1708c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:34.685865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e79f06-298d-455a-81b0-b8f7bdd1708c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:34.697799 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 448/912] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:32:34 2022] GET /identity/v3/role_assignments?user.id=57632a25fe1f4b18b75e9774e87d8ffb&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=f81068136c064fa4a26cdb5606d27c4e => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:35.400140 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed74f61-b694-4b93-b921-0c354c9c0e43 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:35.401178 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed74f61-b694-4b93-b921-0c354c9c0e43 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:35.401178 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed74f61-b694-4b93-b921-0c354c9c0e43 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:35.402474 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 465/913] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:35.408639 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d50c80-8b4d-4e84-87ab-94b7c855956c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:35.410319 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d50c80-8b4d-4e84-87ab-94b7c855956c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:35.410319 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d50c80-8b4d-4e84-87ab-94b7c855956c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:35.429808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c3d50c80-8b4d-4e84-87ab-94b7c855956c None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:35.431094 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c3d50c80-8b4d-4e84-87ab-94b7c855956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:35.488589 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d992ba0-cb18-4fcb-a438-529ee4a08cfc None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:35.489232 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d992ba0-cb18-4fcb-a438-529ee4a08cfc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:35.489724 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d992ba0-cb18-4fcb-a438-529ee4a08cfc None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:35.492739 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 466/914] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:32:35.497674 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a3cb4-1295-4840-bde5-54bae438bd53 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:35.498308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a3cb4-1295-4840-bde5-54bae438bd53 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:35.498838 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a3cb4-1295-4840-bde5-54bae438bd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:35.521948 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-117a3cb4-1295-4840-bde5-54bae438bd53 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:35.524082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-117a3cb4-1295-4840-bde5-54bae438bd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:35.550781 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 449/915] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:32:35.591601 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d50c80-8b4d-4e84-87ab-94b7c855956c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:35.649061 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 467/916] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:32:35.676495 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a3cb4-1295-4840-bde5-54bae438bd53 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:35.718936 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:35.745601 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d50c80-8b4d-4e84-87ab-94b7c855956c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:35.762835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:35.804190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20554c9b-8e36-422f-9473-f208815cdf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:35.805523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20554c9b-8e36-422f-9473-f208815cdf5c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:35.806290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20554c9b-8e36-422f-9473-f208815cdf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:35.806900 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20554c9b-8e36-422f-9473-f208815cdf5c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:35.807814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20554c9b-8e36-422f-9473-f208815cdf5c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:35.809757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20554c9b-8e36-422f-9473-f208815cdf5c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-20554c9b-8e36-422f-9473-f208815cdf5c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:35.827432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:35.828515 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:35.829438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:35.829438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:35.829438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:35.829438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:35.829438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:35.829438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:35.829438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:35.829438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:35.829438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:35.829438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:35.829438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:35.829438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:35.829438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 09:32:35.829438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:35.833067 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 450/917] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:32:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:32:35.843338 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20554c9b-8e36-422f-9473-f208815cdf5c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:35.921433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a3cb4-1295-4840-bde5-54bae438bd53 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:35.997525 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153fe83-5230-492e-a37a-ede1824d963f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:35.998715 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153fe83-5230-492e-a37a-ede1824d963f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:35.999171 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153fe83-5230-492e-a37a-ede1824d963f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:35.999579 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153fe83-5230-492e-a37a-ede1824d963f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:36.000787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153fe83-5230-492e-a37a-ede1824d963f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:36.003773 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153fe83-5230-492e-a37a-ede1824d963f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e153fe83-5230-492e-a37a-ede1824d963f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:36.030556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:36.032248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:36.033777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:36.033777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:36.033777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:36.033777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:36.033777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:36.033777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:36.033777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:36.033777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:36.033777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:36.033777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:36.033777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:36.033777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:36.033777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:36.033777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 09:32:36.033777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:36.042843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 468/918] 10.222.0.45 () {56 vars in 1132 bytes} [Wed Jun 15 09:32:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:36.048649 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153fe83-5230-492e-a37a-ede1824d963f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:36.066271 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20554c9b-8e36-422f-9473-f208815cdf5c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:36.131603 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa27410-0c0a-4ca9-b679-c18a566a6264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:36.133130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa27410-0c0a-4ca9-b679-c18a566a6264 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:36.133280 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa27410-0c0a-4ca9-b679-c18a566a6264 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:36.134225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa27410-0c0a-4ca9-b679-c18a566a6264 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:36.138083 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa27410-0c0a-4ca9-b679-c18a566a6264 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:36.138670 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa27410-0c0a-4ca9-b679-c18a566a6264 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:36.142035 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa27410-0c0a-4ca9-b679-c18a566a6264 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:36.156081 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 451/919] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:32:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:36.157040 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa27410-0c0a-4ca9-b679-c18a566a6264 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:36.172397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:36.198770 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153fe83-5230-492e-a37a-ede1824d963f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:36.200790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:36.240292 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904e192-7d84-4cb8-81b8-d38d83239e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:36.240975 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904e192-7d84-4cb8-81b8-d38d83239e9f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:36.241273 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904e192-7d84-4cb8-81b8-d38d83239e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:36.241533 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904e192-7d84-4cb8-81b8-d38d83239e9f None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:36.243693 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904e192-7d84-4cb8-81b8-d38d83239e9f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:36.243693 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904e192-7d84-4cb8-81b8-d38d83239e9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:36.244007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904e192-7d84-4cb8-81b8-d38d83239e9f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:36.249562 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 469/920] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Jun 15 09:32:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:36.251267 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75de355-024b-4cc7-a59c-0fb822acb6d6 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:36.251267 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75de355-024b-4cc7-a59c-0fb822acb6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:36.251532 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75de355-024b-4cc7-a59c-0fb822acb6d6 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:36.253329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 470/921] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:36.257368 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75de355-024b-4cc7-a59c-0fb822acb6d6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:36.284909 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa27410-0c0a-4ca9-b679-c18a566a6264 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:36.324563 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaf4ac-fdd1-4854-a926-e79adb36862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:36.325565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaf4ac-fdd1-4854-a926-e79adb36862a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:36.325850 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaf4ac-fdd1-4854-a926-e79adb36862a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:36.326133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaf4ac-fdd1-4854-a926-e79adb36862a None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:36.326882 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aaf4ac-fdd1-4854-a926-e79adb36862a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:36.327188 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aaf4ac-fdd1-4854-a926-e79adb36862a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:36.328552 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aaf4ac-fdd1-4854-a926-e79adb36862a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:36.334556 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 452/922] 10.222.0.45 () {56 vars in 1114 bytes} [Wed Jun 15 09:32:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:36.335824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cebd2-f64c-4696-a752-458901aa4e1f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:36.336112 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cebd2-f64c-4696-a752-458901aa4e1f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:36.336387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cebd2-f64c-4696-a752-458901aa4e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:36.354665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-233cebd2-f64c-4696-a752-458901aa4e1f None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:36.355888 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-233cebd2-f64c-4696-a752-458901aa4e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:36.376676 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75de355-024b-4cc7-a59c-0fb822acb6d6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:36.416331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6b611-617d-4e0f-bd96-d6c5d50ba116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:36.417176 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6b611-617d-4e0f-bd96-d6c5d50ba116 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:36.417446 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6b611-617d-4e0f-bd96-d6c5d50ba116 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:36.417849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6b611-617d-4e0f-bd96-d6c5d50ba116 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:36.418593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6b611-617d-4e0f-bd96-d6c5d50ba116 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:36.419067 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6b611-617d-4e0f-bd96-d6c5d50ba116 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:36.421095 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6b611-617d-4e0f-bd96-d6c5d50ba116 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:36.429388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 471/923] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Jun 15 09:32:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:36.430675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6b611-617d-4e0f-bd96-d6c5d50ba116 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:36.434755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 453/924] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:36.435749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cebd2-f64c-4696-a752-458901aa4e1f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:36.454346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:36.467122 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:36.551891 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6b611-617d-4e0f-bd96-d6c5d50ba116 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:36.552046 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cebd2-f64c-4696-a752-458901aa4e1f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:36.589760 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fa9b9-3072-4f91-92fe-1c602357879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:36.590557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fa9b9-3072-4f91-92fe-1c602357879c None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:36.590845 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fa9b9-3072-4f91-92fe-1c602357879c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:36.591125 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fa9b9-3072-4f91-92fe-1c602357879c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:36.591685 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196036a6-326e-47ba-bcf2-fd45327c8d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:36.591883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fa9b9-3072-4f91-92fe-1c602357879c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:36.592354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196036a6-326e-47ba-bcf2-fd45327c8d42 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:36.592642 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196036a6-326e-47ba-bcf2-fd45327c8d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:36.592921 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196036a6-326e-47ba-bcf2-fd45327c8d42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:36.593226 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fa9b9-3072-4f91-92fe-1c602357879c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:36.593666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196036a6-326e-47ba-bcf2-fd45327c8d42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:36.595219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196036a6-326e-47ba-bcf2-fd45327c8d42 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:36.616937 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 472/925] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Jun 15 09:32:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:32:36.617995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fa9b9-3072-4f91-92fe-1c602357879c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:36.632492 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 454/926] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Jun 15 09:32:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:32:36.789623 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:36.828099 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fa9b9-3072-4f91-92fe-1c602357879c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:36.890987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b6288-6269-4c53-bda8-2c0d2e8b892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:36.891850 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b6288-6269-4c53-bda8-2c0d2e8b892f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:36.892130 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b6288-6269-4c53-bda8-2c0d2e8b892f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:36.892408 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b6288-6269-4c53-bda8-2c0d2e8b892f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:36.893604 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b6288-6269-4c53-bda8-2c0d2e8b892f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:36.895212 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b6288-6269-4c53-bda8-2c0d2e8b892f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e51b6288-6269-4c53-bda8-2c0d2e8b892f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:36.909848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:36.911615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:36.913356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:36.913356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:36.913356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:36.913356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:36.913356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:36.913356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:36.913356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:36.913356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:36.913356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:36.913356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:36.913356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:36.913356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:36.913356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 09:32:36.913356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:36.913356 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 473/927] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Jun 15 09:32:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:36.918723 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196036a6-326e-47ba-bcf2-fd45327c8d42 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:37.010269 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:37.066155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196036a6-326e-47ba-bcf2-fd45327c8d42 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:37.109084 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ee854-9a15-496f-b2e7-8b7e76a061d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:37.109678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ee854-9a15-496f-b2e7-8b7e76a061d4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:37.109963 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ee854-9a15-496f-b2e7-8b7e76a061d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:37.110241 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ee854-9a15-496f-b2e7-8b7e76a061d4 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:37.111005 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ee854-9a15-496f-b2e7-8b7e76a061d4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:37.111316 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ee854-9a15-496f-b2e7-8b7e76a061d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:37.112767 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ee854-9a15-496f-b2e7-8b7e76a061d4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:37.123571 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 455/928] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Jun 15 09:32:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:37.125754 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b6288-6269-4c53-bda8-2c0d2e8b892f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:37.290310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b6288-6269-4c53-bda8-2c0d2e8b892f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:37.354745 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cd8ce-1ca8-4e47-a282-472f3572b0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:37.355881 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd8ce-1ca8-4e47-a282-472f3572b0ae None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:37.356381 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd8ce-1ca8-4e47-a282-472f3572b0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:37.356863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd8ce-1ca8-4e47-a282-472f3572b0ae None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:37.358214 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cd8ce-1ca8-4e47-a282-472f3572b0ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:37.358803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cd8ce-1ca8-4e47-a282-472f3572b0ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:37.361539 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cd8ce-1ca8-4e47-a282-472f3572b0ae None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:37.376406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 474/929] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Jun 15 09:32:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:37.382692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ee854-9a15-496f-b2e7-8b7e76a061d4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:37.574429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ee854-9a15-496f-b2e7-8b7e76a061d4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:37.619844 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:37.642235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676904c-de19-4c8f-a836-b4723aefee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:37.643431 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676904c-de19-4c8f-a836-b4723aefee47 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:37.643926 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676904c-de19-4c8f-a836-b4723aefee47 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:37.644414 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676904c-de19-4c8f-a836-b4723aefee47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:37.645946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676904c-de19-4c8f-a836-b4723aefee47 None admin] RBAC: Adding query filter params (interface=public, service_id=fcb01c81ae6742819602be69c61c1134, region_id=RegionOne) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:37.646525 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676904c-de19-4c8f-a836-b4723aefee47 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:37.649062 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676904c-de19-4c8f-a836-b4723aefee47 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:37.666182 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 456/930] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Jun 15 09:32:37 2022] GET /identity/v3/endpoints?service_id=fcb01c81ae6742819602be69c61c1134&interface=public®ion_id=RegionOne => generated 194 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:37.668246 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cd8ce-1ca8-4e47-a282-472f3572b0ae None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:37.693001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:37.864830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cd8ce-1ca8-4e47-a282-472f3572b0ae None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:37.930615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaceac36-b803-4c0e-81eb-8659afad2fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:37.931666 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceac36-b803-4c0e-81eb-8659afad2fdd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:37.932157 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceac36-b803-4c0e-81eb-8659afad2fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:37.932650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceac36-b803-4c0e-81eb-8659afad2fdd None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:37.933961 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaceac36-b803-4c0e-81eb-8659afad2fdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:37.936779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaceac36-b803-4c0e-81eb-8659afad2fdd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:37.954954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 475/931] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Jun 15 09:32:37 2022] GET /identity/v3/services => generated 1497 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 09:32:38.432716 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931d274-3152-4877-a62d-df41e9cf2b9c None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:38.432991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931d274-3152-4877-a62d-df41e9cf2b9c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:38.433393 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931d274-3152-4877-a62d-df41e9cf2b9c None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:38.434968 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 457/932] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:38.440632 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704d310-9035-4d82-9a63-f411395e2ac3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:38.440996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704d310-9035-4d82-9a63-f411395e2ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:38.441246 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704d310-9035-4d82-9a63-f411395e2ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:38.460021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2704d310-9035-4d82-9a63-f411395e2ac3 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:38.461229 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2704d310-9035-4d82-9a63-f411395e2ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:38.568810 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:38.573513 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 476/933] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:38.597096 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931d274-3152-4877-a62d-df41e9cf2b9c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:38.777798 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931d274-3152-4877-a62d-df41e9cf2b9c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:38.842031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6f931-c6e9-423b-adc7-5b1974a6c7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:38.843432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6f931-c6e9-423b-adc7-5b1974a6c7ca None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:38.843905 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6f931-c6e9-423b-adc7-5b1974a6c7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:38.844389 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6f931-c6e9-423b-adc7-5b1974a6c7ca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:38.864807 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6f931-c6e9-423b-adc7-5b1974a6c7ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-64f6f931-c6e9-423b-adc7-5b1974a6c7ca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:32:38.879388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:38.881093 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:38.882644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:38.882644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:38.882644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:38.882644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:38.882644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:32:38.882644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:32:38.882644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:32:38.882644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:32:38.882644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:32:38.882644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:32:38.882644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 09:32:38.882644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:38.882644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 458/934] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Jun 15 09:32:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:38.888853 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704d310-9035-4d82-9a63-f411395e2ac3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:39.005503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704d310-9035-4d82-9a63-f411395e2ac3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:39.043270 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e85d42-7264-4005-9b0e-bd95b63f9c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:39.043866 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e85d42-7264-4005-9b0e-bd95b63f9c11 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:39.044152 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e85d42-7264-4005-9b0e-bd95b63f9c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:39.044434 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e85d42-7264-4005-9b0e-bd95b63f9c11 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:39.045201 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e85d42-7264-4005-9b0e-bd95b63f9c11 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:39.045512 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e85d42-7264-4005-9b0e-bd95b63f9c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:39.047000 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e85d42-7264-4005-9b0e-bd95b63f9c11 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:39.056714 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 477/935] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Jun 15 09:32:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:39.066214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6f931-c6e9-423b-adc7-5b1974a6c7ca None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:39.139586 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:39.205744 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6f931-c6e9-423b-adc7-5b1974a6c7ca None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:39.249761 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf79171-df4d-4470-8b02-0c0b508cc209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:39.250730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf79171-df4d-4470-8b02-0c0b508cc209 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:39.251070 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf79171-df4d-4470-8b02-0c0b508cc209 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:39.251353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf79171-df4d-4470-8b02-0c0b508cc209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:39.266318 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf79171-df4d-4470-8b02-0c0b508cc209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:39.268371 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf79171-df4d-4470-8b02-0c0b508cc209 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:39.296180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-cdf79171-df4d-4470-8b02-0c0b508cc209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:39.296180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:39.296180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:39.296180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:39.296180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:39.296180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:39.296180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:39.296180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:39.296180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:39.296180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:39.296180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:39.296180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:39.296180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:39.296180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:39.296180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:39.297134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:39.298059 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:39.298059 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:39.298059 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:39.298059 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:39.298286 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 459/936] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:39.306857 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e85d42-7264-4005-9b0e-bd95b63f9c11 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:39.437517 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:39.487376 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0800d-66d8-4229-aa6b-6a36732c49ef None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:39.488117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0800d-66d8-4229-aa6b-6a36732c49ef None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:39.488608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0800d-66d8-4229-aa6b-6a36732c49ef None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:39.490491 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 460/937] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:32:39.496290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37199e-b79a-4d24-ac9a-ec00c107308b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:39.496894 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37199e-b79a-4d24-ac9a-ec00c107308b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:39.497402 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37199e-b79a-4d24-ac9a-ec00c107308b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:39.513601 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e85d42-7264-4005-9b0e-bd95b63f9c11 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:39.517103 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-fe37199e-b79a-4d24-ac9a-ec00c107308b None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:39.519050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-fe37199e-b79a-4d24-ac9a-ec00c107308b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:39.564887 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0392a8-e29c-41aa-9c4d-2315fb66fced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:39.565568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0392a8-e29c-41aa-9c4d-2315fb66fced None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:39.565853 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0392a8-e29c-41aa-9c4d-2315fb66fced None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:39.566131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0392a8-e29c-41aa-9c4d-2315fb66fced None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:39.566911 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0392a8-e29c-41aa-9c4d-2315fb66fced None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:39.567224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0392a8-e29c-41aa-9c4d-2315fb66fced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:39.569043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0392a8-e29c-41aa-9c4d-2315fb66fced None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:39.594110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 478/938] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:39.599317 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0392a8-e29c-41aa-9c4d-2315fb66fced None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:39.632265 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 461/939] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:32:39.654750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37199e-b79a-4d24-ac9a-ec00c107308b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:39.726264 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:39.831334 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0392a8-e29c-41aa-9c4d-2315fb66fced None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:39.886309 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37199e-b79a-4d24-ac9a-ec00c107308b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:39.902966 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:39.920731 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15257f03-3dfd-46cc-a303-b77b2e02f5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:39.923152 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15257f03-3dfd-46cc-a303-b77b2e02f5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:39.923628 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15257f03-3dfd-46cc-a303-b77b2e02f5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:39.924170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15257f03-3dfd-46cc-a303-b77b2e02f5d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:39.942610 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15257f03-3dfd-46cc-a303-b77b2e02f5d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:39.947260 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15257f03-3dfd-46cc-a303-b77b2e02f5d7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:39.966655 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70c0d2-95d8-4f7f-8401-dc29d3df9a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:39.968036 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70c0d2-95d8-4f7f-8401-dc29d3df9a56 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:39.968537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70c0d2-95d8-4f7f-8401-dc29d3df9a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:39.969038 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70c0d2-95d8-4f7f-8401-dc29d3df9a56 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:39.970194 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70c0d2-95d8-4f7f-8401-dc29d3df9a56 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:39.973466 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70c0d2-95d8-4f7f-8401-dc29d3df9a56 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-15257f03-3dfd-46cc-a303-b77b2e02f5d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:32:39.983440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:39.984470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:39.985448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:39.985448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:39.985448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:32:39.985448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:32:39.985448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:32:39.985448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:32:39.985448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:32:39.985448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:32:39.985448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 09:32:39.985448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:39.986634 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 479/940] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Jun 15 09:32:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:32:39.988584 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a1b77-97ef-4c17-9ea9-52f0002dbe5c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:39.989095 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a1b77-97ef-4c17-9ea9-52f0002dbe5c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:39.989597 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a1b77-97ef-4c17-9ea9-52f0002dbe5c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-6a70c0d2-95d8-4f7f-8401-dc29d3df9a56 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:39.992228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:39.998106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:39.999031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:39.999031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:39.999031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:39.999031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:39.999031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:39.999031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:39.999031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:39.999031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:39.999031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:39.999031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:39.999031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:39.999031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:39.999031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 09:32:39.999031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:39.999769 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 480/941] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:39.999769 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a1b77-97ef-4c17-9ea9-52f0002dbe5c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:39.999908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 462/942] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:39.999908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2004a64-1257-404c-b13f-22f66b65df20 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:40.000040 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2004a64-1257-404c-b13f-22f66b65df20 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:40.000602 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2004a64-1257-404c-b13f-22f66b65df20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:40.025170 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d2004a64-1257-404c-b13f-22f66b65df20 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:40.026840 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d2004a64-1257-404c-b13f-22f66b65df20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:40.131730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 463/943] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:40.132902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2004a64-1257-404c-b13f-22f66b65df20 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:40.187451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:40.207790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a1b77-97ef-4c17-9ea9-52f0002dbe5c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:40.258277 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7996067-7377-4c55-a1e3-4c36810c114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:40.259203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7996067-7377-4c55-a1e3-4c36810c114c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:40.259705 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7996067-7377-4c55-a1e3-4c36810c114c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:40.260111 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7996067-7377-4c55-a1e3-4c36810c114c None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:40.261583 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7996067-7377-4c55-a1e3-4c36810c114c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:40.261993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7996067-7377-4c55-a1e3-4c36810c114c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:40.263858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7996067-7377-4c55-a1e3-4c36810c114c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:40.292838 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 481/944] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Jun 15 09:32:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:40.292838 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7996067-7377-4c55-a1e3-4c36810c114c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:40.335105 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2004a64-1257-404c-b13f-22f66b65df20 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:40.361729 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:40.385044 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc61ffd-98d3-4193-b7aa-9fb25e8a4bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:40.385987 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc61ffd-98d3-4193-b7aa-9fb25e8a4bbd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:40.386406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc61ffd-98d3-4193-b7aa-9fb25e8a4bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:40.386853 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc61ffd-98d3-4193-b7aa-9fb25e8a4bbd None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:40.387809 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc61ffd-98d3-4193-b7aa-9fb25e8a4bbd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:40.388314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc61ffd-98d3-4193-b7aa-9fb25e8a4bbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:40.389927 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc61ffd-98d3-4193-b7aa-9fb25e8a4bbd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:40.402675 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 464/945] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Jun 15 09:32:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:40.404074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc61ffd-98d3-4193-b7aa-9fb25e8a4bbd None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:40.478345 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7996067-7377-4c55-a1e3-4c36810c114c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:40.532696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:40.546826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c711c-ee5b-4aab-ac68-59578428e57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:40.548037 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c711c-ee5b-4aab-ac68-59578428e57e None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:40.548544 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c711c-ee5b-4aab-ac68-59578428e57e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:40.549048 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c711c-ee5b-4aab-ac68-59578428e57e None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:40.550187 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c711c-ee5b-4aab-ac68-59578428e57e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:40.552710 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c711c-ee5b-4aab-ac68-59578428e57e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:40.554833 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: WARNING keystone.server.flask.common [None req-a53c711c-ee5b-4aab-ac68-59578428e57e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 15 09:32:40.564343 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc61ffd-98d3-4193-b7aa-9fb25e8a4bbd None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:40.586942 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.sql.core [None req-a53c711c-ee5b-4aab-ac68-59578428e57e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 09:32:40.586942 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 15 09:32:40.586942 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [parameters: {'id': 'f4f37bd7d8ad4510afdeff92b1067bac', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 15 09:32:40.586942 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80319) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 09:32:40.602406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a53c711c-ee5b-4aab-ac68-59578428e57e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f4f37bd7d8ad4510afdeff92b1067bac.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f4f37bd7d8ad4510afdeff92b1067bac. Jun 15 09:32:40.602406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:40.602406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 09:32:40.602406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 09:32:40.602406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 09:32:40.602406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 09:32:40.602406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 09:32:40.602406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 09:32:40.602406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 09:32:40.602406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) Jun 15 09:32:40.602406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 09:32:40.602406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 09:32:40.602406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 15 09:32:40.603915 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application yield resource Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise self.value Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application session.commit() Jun 15 09:32:40.604880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.flush() Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application compat.raise_( Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 09:32:40.605863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 09:32:40.606910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 09:32:40.606910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 09:32:40.606910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 09:32:40.606910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 09:32:40.606910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 15 09:32:40.606910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 15 09:32:40.606910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 09:32:40.606910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 09:32:40.606910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 09:32:40.606910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 09:32:40.606910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 09:32:40.606910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 09:32:40.606910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 09:32:40.606910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 09:32:40.606910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 09:32:40.607785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 09:32:40.608813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 09:32:40.608813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 09:32:40.608813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 09:32:40.608813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 09:32:40.608813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 09:32:40.608813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 09:32:40.608813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 09:32:40.608813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 15 09:32:40.608813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [parameters: {'id': 'f4f37bd7d8ad4510afdeff92b1067bac', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 15 09:32:40.608813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 09:32:40.608813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:40.608813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:40.608813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:40.608813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:40.608813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:40.609671 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:40.613972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:40.613972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 15 09:32:40.613972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 15 09:32:40.613972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:40.613972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:40.613972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 15 09:32:40.613972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 15 09:32:40.613972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f4f37bd7d8ad4510afdeff92b1067bac. Jun 15 09:32:40.613972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:40.613972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 482/946] 10.222.0.45 () {60 vars in 1140 bytes} [Wed Jun 15 09:32:40 2022] POST /identity/v3/projects => generated 262 bytes in 323 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:40.616681 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c711c-ee5b-4aab-ac68-59578428e57e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:40.622869 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1632750-1ebe-4712-ab1f-1ff8987d5c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:40.623857 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1632750-1ebe-4712-ab1f-1ff8987d5c45 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:40.624311 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1632750-1ebe-4712-ab1f-1ff8987d5c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:40.624800 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1632750-1ebe-4712-ab1f-1ff8987d5c45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:40.640498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1632750-1ebe-4712-ab1f-1ff8987d5c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:40.642915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1632750-1ebe-4712-ab1f-1ff8987d5c45 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:40.665907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f1632750-1ebe-4712-ab1f-1ff8987d5c45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:40.665907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:40.665907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:40.665907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:40.665907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:40.665907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:40.665907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:40.665907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:40.665907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:40.665907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:40.665907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:40.665907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:40.665907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:40.665907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:40.665907 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:40.669033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:40.672715 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:40.672715 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:40.672715 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:40.672715 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:40.672715 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 465/947] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:40.672715 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1632750-1ebe-4712-ab1f-1ff8987d5c45 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:40.782622 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:40.793169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c711c-ee5b-4aab-ac68-59578428e57e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:40.814375 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1632750-1ebe-4712-ab1f-1ff8987d5c45 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:40.845838 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ba4b1-a589-4515-9d0f-3b6f27a67501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:40.846990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ba4b1-a589-4515-9d0f-3b6f27a67501 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:40.847438 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ba4b1-a589-4515-9d0f-3b6f27a67501 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:40.847959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ba4b1-a589-4515-9d0f-3b6f27a67501 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:40.849229 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ba4b1-a589-4515-9d0f-3b6f27a67501 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:40.849734 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ba4b1-a589-4515-9d0f-3b6f27a67501 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:40.852495 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ba4b1-a589-4515-9d0f-3b6f27a67501 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:40.878597 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 483/948] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Jun 15 09:32:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:40.878597 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ba4b1-a589-4515-9d0f-3b6f27a67501 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:40.878969 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea619f12-2c48-4701-a0a2-7867046440d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:40.878969 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea619f12-2c48-4701-a0a2-7867046440d4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:40.878969 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea619f12-2c48-4701-a0a2-7867046440d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:40.878969 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea619f12-2c48-4701-a0a2-7867046440d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:40.888871 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea619f12-2c48-4701-a0a2-7867046440d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:40.890732 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea619f12-2c48-4701-a0a2-7867046440d4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:40.895014 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:40.912275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ea619f12-2c48-4701-a0a2-7867046440d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:40.912275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:40.912275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:40.912275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:40.912275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:40.912275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:40.912275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:40.912275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:40.912275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:40.912275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:40.912275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:40.912275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:40.912275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:40.912275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:40.912275 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:40.914034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:40.915849 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:40.915849 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:40.915849 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:40.915849 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:40.915849 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:40.915849 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:40.915849 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:40.915849 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:40.915849 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 466/949] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:40.916810 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62419051-2e83-4c21-ab04-c24dff0b80d0 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:40.918041 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62419051-2e83-4c21-ab04-c24dff0b80d0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:40.918041 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62419051-2e83-4c21-ab04-c24dff0b80d0 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:40.920217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 467/950] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:40.927356 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62419051-2e83-4c21-ab04-c24dff0b80d0 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:41.035353 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ba4b1-a589-4515-9d0f-3b6f27a67501 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:41.090154 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1883591-e246-4aa6-b066-5e8085a498fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:41.091057 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1883591-e246-4aa6-b066-5e8085a498fb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:41.091488 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1883591-e246-4aa6-b066-5e8085a498fb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:41.092009 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1883591-e246-4aa6-b066-5e8085a498fb None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:41.092873 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1883591-e246-4aa6-b066-5e8085a498fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:41.093686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1883591-e246-4aa6-b066-5e8085a498fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:41.095138 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1883591-e246-4aa6-b066-5e8085a498fb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:41.110330 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 484/951] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:41.112394 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc105b8a-d820-47b5-b1f2-03f7efb12565 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:41.112681 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc105b8a-d820-47b5-b1f2-03f7efb12565 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:41.113720 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc105b8a-d820-47b5-b1f2-03f7efb12565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:41.126774 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62419051-2e83-4c21-ab04-c24dff0b80d0 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:41.141721 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cc105b8a-d820-47b5-b1f2-03f7efb12565 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:41.144104 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cc105b8a-d820-47b5-b1f2-03f7efb12565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:41.166070 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:41.187341 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71103849-e8fa-4279-bd56-83753483a57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:41.188484 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71103849-e8fa-4279-bd56-83753483a57c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:41.188960 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71103849-e8fa-4279-bd56-83753483a57c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:41.189469 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71103849-e8fa-4279-bd56-83753483a57c None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:41.190892 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71103849-e8fa-4279-bd56-83753483a57c None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:41.191437 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71103849-e8fa-4279-bd56-83753483a57c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:41.194099 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71103849-e8fa-4279-bd56-83753483a57c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:41.227418 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 468/952] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Jun 15 09:32:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:41.229091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71103849-e8fa-4279-bd56-83753483a57c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:41.240774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 485/953] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:41.293064 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc105b8a-d820-47b5-b1f2-03f7efb12565 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:41.354440 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:41.430478 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71103849-e8fa-4279-bd56-83753483a57c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:41.499406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71b348-51d1-461b-b659-ffd986ec7b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:41.500266 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b348-51d1-461b-b659-ffd986ec7b31 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:41.500554 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b348-51d1-461b-b659-ffd986ec7b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:41.500826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b348-51d1-461b-b659-ffd986ec7b31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:41.501313 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc105b8a-d820-47b5-b1f2-03f7efb12565 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:41.510964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71b348-51d1-461b-b659-ffd986ec7b31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:41.512444 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71b348-51d1-461b-b659-ffd986ec7b31 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:41.535522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-8a71b348-51d1-461b-b659-ffd986ec7b31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:41.535522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:41.535522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:41.535522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:41.535522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:41.535522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:41.535522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:41.535522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:41.535522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:41.535522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:41.535522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:41.535522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:41.535522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:41.535522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:41.535522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:41.537335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:41.539278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:41.539278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:41.539278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:41.539278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:41.539278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:41.539278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:41.539278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:41.539278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:41.539278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 469/954] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:41.546864 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71b348-51d1-461b-b659-ffd986ec7b31 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:41.569195 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94c2c6-336d-4535-8c71-74ce8fc8f02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:41.570333 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94c2c6-336d-4535-8c71-74ce8fc8f02a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:41.570715 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94c2c6-336d-4535-8c71-74ce8fc8f02a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:41.570989 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94c2c6-336d-4535-8c71-74ce8fc8f02a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:41.573006 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94c2c6-336d-4535-8c71-74ce8fc8f02a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:41.573006 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94c2c6-336d-4535-8c71-74ce8fc8f02a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7c94c2c6-336d-4535-8c71-74ce8fc8f02a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:41.588352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:41.598251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:41.600169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:41.600169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:41.600169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:41.600169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:41.600169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:41.600169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:41.600169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:41.600169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:41.600169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:41.600169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:41.600169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:41.600169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:41.600169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 09:32:41.600169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:41.600169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 486/955] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Jun 15 09:32:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:32:41.601726 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94c2c6-336d-4535-8c71-74ce8fc8f02a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:41.644288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:41.716089 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71b348-51d1-461b-b659-ffd986ec7b31 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:41.741341 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:41.763764 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfab1b-3f22-415c-b3dd-c5bf36a55847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:41.764702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfab1b-3f22-415c-b3dd-c5bf36a55847 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:41.765092 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfab1b-3f22-415c-b3dd-c5bf36a55847 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:41.765473 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfab1b-3f22-415c-b3dd-c5bf36a55847 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:41.766641 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfab1b-3f22-415c-b3dd-c5bf36a55847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:41.766892 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfab1b-3f22-415c-b3dd-c5bf36a55847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:41.769061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfab1b-3f22-415c-b3dd-c5bf36a55847 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:41.789398 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 470/956] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:41.790534 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfab1b-3f22-415c-b3dd-c5bf36a55847 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:41.845794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94c2c6-336d-4535-8c71-74ce8fc8f02a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:41.904935 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfab1b-3f22-415c-b3dd-c5bf36a55847 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:41.915451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86a88f-d47f-4668-8999-d577fec05d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:41.917078 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86a88f-d47f-4668-8999-d577fec05d27 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:41.917947 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86a88f-d47f-4668-8999-d577fec05d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:41.918700 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86a88f-d47f-4668-8999-d577fec05d27 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:41.920261 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86a88f-d47f-4668-8999-d577fec05d27 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:41.921187 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86a88f-d47f-4668-8999-d577fec05d27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:41.924285 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86a88f-d47f-4668-8999-d577fec05d27 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:41.940484 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 487/957] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Jun 15 09:32:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:41.944031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb1e5b-f838-4ac1-81e9-81ceb72f77a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:41.945099 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb1e5b-f838-4ac1-81e9-81ceb72f77a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:41.945454 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb1e5b-f838-4ac1-81e9-81ceb72f77a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:41.945803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb1e5b-f838-4ac1-81e9-81ceb72f77a5 None admin] PATH_INFO: `/v3/projects/b978d75b349941f5bedbe56544f41ada/users/57632a25fe1f4b18b75e9774e87d8ffb/roles/f81068136c064fa4a26cdb5606d27c4e` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:41.947875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86a88f-d47f-4668-8999-d577fec05d27 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:41.948382 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb1e5b-f838-4ac1-81e9-81ceb72f77a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b978d75b349941f5bedbe56544f41ada, user_id=57632a25fe1f4b18b75e9774e87d8ffb, role_id=f81068136c064fa4a26cdb5606d27c4e)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:41.949916 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb1e5b-f838-4ac1-81e9-81ceb72f77a5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:41.970569 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 471/958] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:32:41 2022] PUT /identity/v3/projects/b978d75b349941f5bedbe56544f41ada/users/57632a25fe1f4b18b75e9774e87d8ffb/roles/f81068136c064fa4a26cdb5606d27c4e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:32:42.104375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:42.133547 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86a88f-d47f-4668-8999-d577fec05d27 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:42.177220 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ce12a-66db-4cbd-be8b-97ed2897940a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:42.177924 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ce12a-66db-4cbd-be8b-97ed2897940a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:42.178209 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ce12a-66db-4cbd-be8b-97ed2897940a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:42.178485 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ce12a-66db-4cbd-be8b-97ed2897940a None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:42.179267 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ce12a-66db-4cbd-be8b-97ed2897940a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:42.179574 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ce12a-66db-4cbd-be8b-97ed2897940a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:42.181006 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ce12a-66db-4cbd-be8b-97ed2897940a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:42.187445 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 488/959] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Jun 15 09:32:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:42.193846 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb1e5b-f838-4ac1-81e9-81ceb72f77a5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:42.246068 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:42.320790 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb1e5b-f838-4ac1-81e9-81ceb72f77a5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:42.360413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea34ac4-c336-4131-b3c3-783e89e47f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:42.361101 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea34ac4-c336-4131-b3c3-783e89e47f45 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:42.361932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea34ac4-c336-4131-b3c3-783e89e47f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:42.362213 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea34ac4-c336-4131-b3c3-783e89e47f45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:42.363019 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea34ac4-c336-4131-b3c3-783e89e47f45 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:42.364413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea34ac4-c336-4131-b3c3-783e89e47f45 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:42.389737 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 472/960] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Jun 15 09:32:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:32:43.190841 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6cdbc-720b-48fa-9896-a6a53bff4045 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:43.191399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6cdbc-720b-48fa-9896-a6a53bff4045 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:43.191399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6cdbc-720b-48fa-9896-a6a53bff4045 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:43.193087 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 489/961] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:43.198927 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e640a-2698-417a-a237-095c0f58a2c0 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:43.199401 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e640a-2698-417a-a237-095c0f58a2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:43.199505 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e640a-2698-417a-a237-095c0f58a2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:43.217761 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-984e640a-2698-417a-a237-095c0f58a2c0 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:43.219111 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-984e640a-2698-417a-a237-095c0f58a2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:43.302303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 473/962] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:32:43.326462 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6cdbc-720b-48fa-9896-a6a53bff4045 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:43.514091 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6cdbc-720b-48fa-9896-a6a53bff4045 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:43.580596 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ee012-3226-4d28-a580-920ce68c5b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:43.581826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ee012-3226-4d28-a580-920ce68c5b0b None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:43.582398 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ee012-3226-4d28-a580-920ce68c5b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:43.582928 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ee012-3226-4d28-a580-920ce68c5b0b None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:43.584317 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ee012-3226-4d28-a580-920ce68c5b0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:43.587016 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ee012-3226-4d28-a580-920ce68c5b0b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:43.615099 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 490/963] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Jun 15 09:32:43 2022] POST /identity/v3/services => generated 242 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 09:32:44.326299 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc6e95-130b-4617-9746-7d603ed86543 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:44.327054 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc6e95-130b-4617-9746-7d603ed86543 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:44.327054 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc6e95-130b-4617-9746-7d603ed86543 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:44.328627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 474/964] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:44.334201 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eeb9e-c835-45da-b26e-e17c1b4bb843 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:44.335161 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eeb9e-c835-45da-b26e-e17c1b4bb843 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:44.335686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2eeb9e-c835-45da-b26e-e17c1b4bb843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:44.341112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:44.359063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cd2eeb9e-c835-45da-b26e-e17c1b4bb843 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:44.360633 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cd2eeb9e-c835-45da-b26e-e17c1b4bb843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:44.493444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 491/965] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:44.516462 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc6e95-130b-4617-9746-7d603ed86543 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:44.544935 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:44.632084 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc6e95-130b-4617-9746-7d603ed86543 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:44.672035 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6211a2b-f3df-4bca-9e00-7497dc9e089a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:44.672878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6211a2b-f3df-4bca-9e00-7497dc9e089a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:44.673164 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6211a2b-f3df-4bca-9e00-7497dc9e089a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:44.673487 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6211a2b-f3df-4bca-9e00-7497dc9e089a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:44.685347 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6211a2b-f3df-4bca-9e00-7497dc9e089a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a6211a2b-f3df-4bca-9e00-7497dc9e089a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:32:44.693776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:44.694824 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:44.695679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:44.695679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:44.695679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:44.695679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:44.695679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:32:44.695679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:32:44.695679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:32:44.695679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:32:44.695679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:32:44.695679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:32:44.695679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 09:32:44.695679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:44.695679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 475/966] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Jun 15 09:32:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:44.701363 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2eeb9e-c835-45da-b26e-e17c1b4bb843 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:44.831441 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45529113-28d6-4800-a845-eec3f81d702f None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:44.831792 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45529113-28d6-4800-a845-eec3f81d702f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:44.832033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45529113-28d6-4800-a845-eec3f81d702f None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:44.833859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 476/967] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:32:44.839721 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee8d3e-b99c-41e7-93f2-b82f180101b3 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:44.840040 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee8d3e-b99c-41e7-93f2-b82f180101b3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:44.840399 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee8d3e-b99c-41e7-93f2-b82f180101b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:44.856043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2eeb9e-c835-45da-b26e-e17c1b4bb843 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:44.859217 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-63ee8d3e-b99c-41e7-93f2-b82f180101b3 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:44.860572 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-63ee8d3e-b99c-41e7-93f2-b82f180101b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:44.912880 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:44.929295 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f8146-2b33-406b-a050-44093d858faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:44.930478 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f8146-2b33-406b-a050-44093d858faf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:44.931035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f8146-2b33-406b-a050-44093d858faf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:44.931539 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f8146-2b33-406b-a050-44093d858faf None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:44.932997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f8146-2b33-406b-a050-44093d858faf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:44.933559 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f8146-2b33-406b-a050-44093d858faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:44.936240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f8146-2b33-406b-a050-44093d858faf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:44.961379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 492/968] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Jun 15 09:32:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:44.961379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07deb3a-1d4e-42fe-9f8b-56c2cd935a87 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:44.961379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07deb3a-1d4e-42fe-9f8b-56c2cd935a87 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:44.961379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07deb3a-1d4e-42fe-9f8b-56c2cd935a87 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:44.964900 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 477/969] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:32:44.970574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee8d3e-b99c-41e7-93f2-b82f180101b3 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:44.970830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 493/970] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:44 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:44.970830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d20760-3892-4b82-9ba2-eaa4add466c3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:44.971102 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d20760-3892-4b82-9ba2-eaa4add466c3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:44.971553 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d20760-3892-4b82-9ba2-eaa4add466c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:44.999032 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:45.000122 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-54d20760-3892-4b82-9ba2-eaa4add466c3 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:45.002870 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-54d20760-3892-4b82-9ba2-eaa4add466c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:45.110733 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 494/971] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:45.112147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d20760-3892-4b82-9ba2-eaa4add466c3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:45.162122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee8d3e-b99c-41e7-93f2-b82f180101b3 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:45.227058 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e860e7d-4978-4d11-86a0-f5bc199ec385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:45.228353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e860e7d-4978-4d11-86a0-f5bc199ec385 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:45.228788 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e860e7d-4978-4d11-86a0-f5bc199ec385 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:45.229081 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e860e7d-4978-4d11-86a0-f5bc199ec385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:45.248230 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e860e7d-4978-4d11-86a0-f5bc199ec385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:45.249751 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e860e7d-4978-4d11-86a0-f5bc199ec385 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:45.249904 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d20760-3892-4b82-9ba2-eaa4add466c3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:45.272971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-5e860e7d-4978-4d11-86a0-f5bc199ec385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:45.272971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:45.272971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:45.272971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:45.272971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:45.272971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:45.272971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:45.272971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:45.272971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:45.272971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:45.272971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:45.272971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:45.272971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:45.272971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:45.272971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:45.274009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:45.274967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:45.274967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:45.274967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:45.274967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:45.274967 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 478/972] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:45.275333 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e860e7d-4978-4d11-86a0-f5bc199ec385 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:45.280515 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:45.299939 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bea92-8638-49d1-949c-d7301cd1f59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:45.300639 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bea92-8638-49d1-949c-d7301cd1f59a None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:45.300922 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bea92-8638-49d1-949c-d7301cd1f59a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:45.301196 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bea92-8638-49d1-949c-d7301cd1f59a None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:45.301917 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bea92-8638-49d1-949c-d7301cd1f59a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:45.303433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bea92-8638-49d1-949c-d7301cd1f59a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:45.320136 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.sql.core [None req-4e3bea92-8638-49d1-949c-d7301cd1f59a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 09:32:45.320136 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 15 09:32:45.320136 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [parameters: {'user_id': '21fc3c22e67f4f2693bc93656f8c8ab3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 15 09:32:45.320136 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80319) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 09:32:45.327955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4e3bea92-8638-49d1-949c-d7301cd1f59a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 15 09:32:45.327955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:45.327955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 09:32:45.327955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 09:32:45.327955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 09:32:45.327955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 09:32:45.327955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 09:32:45.327955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 09:32:45.327955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 09:32:45.327955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) Jun 15 09:32:45.327955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 09:32:45.327955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 09:32:45.327955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 09:32:45.327955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() Jun 15 09:32:45.327955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 09:32:45.329575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application yield resource Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise self.value Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application session.commit() Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 09:32:45.332371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.flush() Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application compat.raise_( Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 09:32:45.335956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 09:32:45.338851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 09:32:45.340686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 09:32:45.342451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 09:32:45.342451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 09:32:45.342451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 09:32:45.342451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 09:32:45.342451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 09:32:45.342451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 15 09:32:45.342451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [parameters: {'user_id': '21fc3c22e67f4f2693bc93656f8c8ab3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 15 09:32:45.342451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 09:32:45.342451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:45.342451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:45.342451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:45.342451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:45.342451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:45.342451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:45.342451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 15 09:32:45.344132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 15 09:32:45.346005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 15 09:32:45.346005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 15 09:32:45.346005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 09:32:45.346005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 09:32:45.346005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 15 09:32:45.346005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:45.346005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 495/973] 10.222.0.45 () {60 vars in 1131 bytes} [Wed Jun 15 09:32:45 2022] POST /identity/v3/users => generated 160 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:45.346005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bea92-8638-49d1-949c-d7301cd1f59a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:45.388771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:45.441426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e860e7d-4978-4d11-86a0-f5bc199ec385 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:45.488851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bea92-8638-49d1-949c-d7301cd1f59a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:45.497003 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ce367-2226-4c81-9cc3-98a9088cdfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:45.498304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ce367-2226-4c81-9cc3-98a9088cdfc5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:45.498798 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ce367-2226-4c81-9cc3-98a9088cdfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:45.499256 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ce367-2226-4c81-9cc3-98a9088cdfc5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:45.500384 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ce367-2226-4c81-9cc3-98a9088cdfc5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:45.502541 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ce367-2226-4c81-9cc3-98a9088cdfc5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-d96ce367-2226-4c81-9cc3-98a9088cdfc5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:45.523660 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:45.525532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:45.527915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:45.527915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:45.527915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:45.527915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:45.527915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:45.527915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:45.527915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:45.527915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:45.527915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:45.527915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:45.527915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:45.527915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:45.527915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 09:32:45.527915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:45.527915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 479/974] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Jun 15 09:32:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:45.529653 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ce367-2226-4c81-9cc3-98a9088cdfc5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:45.566965 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084dc47-d12a-4060-8a96-7ede2b64c9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:45.568096 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084dc47-d12a-4060-8a96-7ede2b64c9de None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:45.569293 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084dc47-d12a-4060-8a96-7ede2b64c9de None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:45.569293 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084dc47-d12a-4060-8a96-7ede2b64c9de None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:45.570396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084dc47-d12a-4060-8a96-7ede2b64c9de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:45.570985 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084dc47-d12a-4060-8a96-7ede2b64c9de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:45.573958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084dc47-d12a-4060-8a96-7ede2b64c9de None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:45.604223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 496/975] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:45.605792 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084dc47-d12a-4060-8a96-7ede2b64c9de None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:45.659568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:45.707047 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ce367-2226-4c81-9cc3-98a9088cdfc5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:45.743785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084dc47-d12a-4060-8a96-7ede2b64c9de None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:45.758597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:45.775900 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7bba6-3279-4847-9073-0b4fbdaad406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:45.777235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7bba6-3279-4847-9073-0b4fbdaad406 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:45.777705 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7bba6-3279-4847-9073-0b4fbdaad406 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:45.778327 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7bba6-3279-4847-9073-0b4fbdaad406 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:45.784731 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ead926-e86f-491d-8b38-6d26c83df3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:45.785418 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ead926-e86f-491d-8b38-6d26c83df3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:45.785706 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ead926-e86f-491d-8b38-6d26c83df3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:45.785986 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ead926-e86f-491d-8b38-6d26c83df3f1 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:45.786749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ead926-e86f-491d-8b38-6d26c83df3f1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:45.787062 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ead926-e86f-491d-8b38-6d26c83df3f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:45.788479 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ead926-e86f-491d-8b38-6d26c83df3f1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:45.794644 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 497/976] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Jun 15 09:32:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:45.795419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ead926-e86f-491d-8b38-6d26c83df3f1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:45.802076 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7bba6-3279-4847-9073-0b4fbdaad406 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:45.803949 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7bba6-3279-4847-9073-0b4fbdaad406 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-57f7bba6-3279-4847-9073-0b4fbdaad406 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:32:45.820636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:45.821872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:45.823117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:45.823117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:45.823117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:32:45.823117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:32:45.823117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:32:45.823117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:32:45.823117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:32:45.823117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:32:45.823117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 09:32:45.823117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:45.825475 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 480/977] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:32:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:45.826681 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7bba6-3279-4847-9073-0b4fbdaad406 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:45.932644 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ead926-e86f-491d-8b38-6d26c83df3f1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:45.942950 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:45.946825 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7bba6-3279-4847-9073-0b4fbdaad406 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:45.982561 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a200c-11df-4b9f-b9e6-10d2a43ca7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:45.983734 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a200c-11df-4b9f-b9e6-10d2a43ca7db None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:45.984206 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a200c-11df-4b9f-b9e6-10d2a43ca7db None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:45.984605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a200c-11df-4b9f-b9e6-10d2a43ca7db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:45.991380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aff76a-3a60-470d-b432-4be80dc519c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:45.992081 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aff76a-3a60-470d-b432-4be80dc519c2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:45.992361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aff76a-3a60-470d-b432-4be80dc519c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:45.992644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aff76a-3a60-470d-b432-4be80dc519c2 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:45.993399 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aff76a-3a60-470d-b432-4be80dc519c2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:45.993709 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aff76a-3a60-470d-b432-4be80dc519c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:45.995311 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aff76a-3a60-470d-b432-4be80dc519c2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:45.995904 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a200c-11df-4b9f-b9e6-10d2a43ca7db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:45.997846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a200c-11df-4b9f-b9e6-10d2a43ca7db None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:46.002134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 481/978] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Jun 15 09:32:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:46.003197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aff76a-3a60-470d-b432-4be80dc519c2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d90a200c-11df-4b9f-b9e6-10d2a43ca7db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:32:46.024794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:46.026759 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:46.028779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:46.028779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:46.028779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:32:46.028779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:32:46.028779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:32:46.028779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:32:46.028779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:32:46.028779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:32:46.028779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 09:32:46.028779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:46.028779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 498/979] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Jun 15 09:32:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:46.028779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a200c-11df-4b9f-b9e6-10d2a43ca7db None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:46.102680 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:46.144749 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a200c-11df-4b9f-b9e6-10d2a43ca7db None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:46.177065 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aff76a-3a60-470d-b432-4be80dc519c2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:46.188807 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d283ca-df6a-4726-99f9-30b9908e7c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:46.190156 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d283ca-df6a-4726-99f9-30b9908e7c81 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:46.190677 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d283ca-df6a-4726-99f9-30b9908e7c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:46.191061 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d283ca-df6a-4726-99f9-30b9908e7c81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:46.192133 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d283ca-df6a-4726-99f9-30b9908e7c81 None admin] RBAC: Adding query filter params (interface=admin, service_id=fcb01c81ae6742819602be69c61c1134, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:46.192508 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d283ca-df6a-4726-99f9-30b9908e7c81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:46.194123 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d283ca-df6a-4726-99f9-30b9908e7c81 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:46.201193 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 499/980] 10.222.0.45 () {56 vars in 1249 bytes} [Wed Jun 15 09:32:46 2022] GET /identity/v3/endpoints?service_id=fcb01c81ae6742819602be69c61c1134&interface=admin®ion_id=RegionOne => generated 193 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:46.202681 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d283ca-df6a-4726-99f9-30b9908e7c81 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:46.230540 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db1731-8ed1-41fc-90fa-fd8763359008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:46.231329 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db1731-8ed1-41fc-90fa-fd8763359008 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:46.231617 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db1731-8ed1-41fc-90fa-fd8763359008 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:46.231899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db1731-8ed1-41fc-90fa-fd8763359008 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:46.232765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db1731-8ed1-41fc-90fa-fd8763359008 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:46.233076 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db1731-8ed1-41fc-90fa-fd8763359008 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:46.234656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db1731-8ed1-41fc-90fa-fd8763359008 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:46.250113 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:46.275184 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 482/981] 10.222.0.45 () {56 vars in 1101 bytes} [Wed Jun 15 09:32:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:46.276610 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72393266-c6ad-40ff-9862-ca6700cd01f0 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:46.276902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72393266-c6ad-40ff-9862-ca6700cd01f0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:46.277185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72393266-c6ad-40ff-9862-ca6700cd01f0 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:46.278870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 483/982] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:46.279412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72393266-c6ad-40ff-9862-ca6700cd01f0 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:46.349234 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d283ca-df6a-4726-99f9-30b9908e7c81 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:46.407504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa679a7-2419-46f2-90fc-4c8137c53775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:46.408770 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa679a7-2419-46f2-90fc-4c8137c53775 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:46.409232 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa679a7-2419-46f2-90fc-4c8137c53775 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:46.409508 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa679a7-2419-46f2-90fc-4c8137c53775 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:46.410390 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa679a7-2419-46f2-90fc-4c8137c53775 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:46.410729 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa679a7-2419-46f2-90fc-4c8137c53775 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:46.412229 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa679a7-2419-46f2-90fc-4c8137c53775 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:46.424348 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72393266-c6ad-40ff-9862-ca6700cd01f0 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:46.434868 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 500/983] 10.222.0.45 () {56 vars in 1149 bytes} [Wed Jun 15 09:32:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:46.436005 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5b91b-e01b-4269-bb95-db1ccb29a3e2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:46.436289 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5b91b-e01b-4269-bb95-db1ccb29a3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:46.436565 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5b91b-e01b-4269-bb95-db1ccb29a3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:46.446589 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:46.457427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-26d5b91b-e01b-4269-bb95-db1ccb29a3e2 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:46.459041 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-26d5b91b-e01b-4269-bb95-db1ccb29a3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:46.476802 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d2d68-b704-4de1-af32-473cc7a4bd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:46.477511 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d2d68-b704-4de1-af32-473cc7a4bd39 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:46.477819 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d2d68-b704-4de1-af32-473cc7a4bd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:46.478094 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d2d68-b704-4de1-af32-473cc7a4bd39 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:46.479032 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d2d68-b704-4de1-af32-473cc7a4bd39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:46.480334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d2d68-b704-4de1-af32-473cc7a4bd39 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:46.488130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 484/984] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Jun 15 09:32:46 2022] GET /identity/v3/services => generated 1727 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 09:32:46.488842 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d2d68-b704-4de1-af32-473cc7a4bd39 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:46.603237 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 501/985] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:46.626786 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5b91b-e01b-4269-bb95-db1ccb29a3e2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:46.654203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:46.681230 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d2d68-b704-4de1-af32-473cc7a4bd39 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:46.725476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf85d2-b77e-41e2-9f69-b98fa29abdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:46.726154 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf85d2-b77e-41e2-9f69-b98fa29abdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:46.726433 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf85d2-b77e-41e2-9f69-b98fa29abdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:46.726740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf85d2-b77e-41e2-9f69-b98fa29abdd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:46.784239 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5b91b-e01b-4269-bb95-db1ccb29a3e2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:46.795012 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:46.835912 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79a767-8ddb-492c-aa0c-0879232f0f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:46.836615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79a767-8ddb-492c-aa0c-0879232f0f25 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:46.836902 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79a767-8ddb-492c-aa0c-0879232f0f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:46.837182 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79a767-8ddb-492c-aa0c-0879232f0f25 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:46.837847 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79a767-8ddb-492c-aa0c-0879232f0f25 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:46.839275 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79a767-8ddb-492c-aa0c-0879232f0f25 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:46.844627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf85d2-b77e-41e2-9f69-b98fa29abdd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:46.846705 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf85d2-b77e-41e2-9f69-b98fa29abdd5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1d79a767-8ddb-492c-aa0c-0879232f0f25 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:46.862143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:46.864473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:46.866432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:46.866432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:46.866432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:46.866432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:46.866432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:46.866432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:46.866432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:46.866432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:46.866432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:46.866432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:46.866432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:46.866432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:46.866432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 09:32:46.866432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:46.875857 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 502/986] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:32:46.878297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79a767-8ddb-492c-aa0c-0879232f0f25 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:47.007656 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:47.035469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79a767-8ddb-492c-aa0c-0879232f0f25 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:47.044928 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 485/987] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:32:46 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:32:47.052906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf85d2-b77e-41e2-9f69-b98fa29abdd5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:47.106899 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cd393-975a-4caa-b733-b2441832080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:47.106899 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cd393-975a-4caa-b733-b2441832080f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:47.106899 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cd393-975a-4caa-b733-b2441832080f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:47.107376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cd393-975a-4caa-b733-b2441832080f None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:47.107825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cd393-975a-4caa-b733-b2441832080f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:47.108138 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cd393-975a-4caa-b733-b2441832080f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:47.109539 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cd393-975a-4caa-b733-b2441832080f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:47.115901 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 503/988] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Jun 15 09:32:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:47.121750 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cd393-975a-4caa-b733-b2441832080f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:47.185193 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:47.230771 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf85d2-b77e-41e2-9f69-b98fa29abdd5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:47.287766 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cd393-975a-4caa-b733-b2441832080f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:47.291346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9906c-66ca-43af-8b6f-793b1cb80038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:47.292804 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9906c-66ca-43af-8b6f-793b1cb80038 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:47.293324 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9906c-66ca-43af-8b6f-793b1cb80038 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:47.293767 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9906c-66ca-43af-8b6f-793b1cb80038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:47.311619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9906c-66ca-43af-8b6f-793b1cb80038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:47.314685 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9906c-66ca-43af-8b6f-793b1cb80038 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:47.327954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221abeb0-2db7-43d9-b41e-924614f595e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:47.328636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221abeb0-2db7-43d9-b41e-924614f595e0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:47.328953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221abeb0-2db7-43d9-b41e-924614f595e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:47.329201 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221abeb0-2db7-43d9-b41e-924614f595e0 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:47.330490 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221abeb0-2db7-43d9-b41e-924614f595e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:47.330831 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221abeb0-2db7-43d9-b41e-924614f595e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:47.332489 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221abeb0-2db7-43d9-b41e-924614f595e0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:47.338250 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 504/989] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Jun 15 09:32:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:47.343910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221abeb0-2db7-43d9-b41e-924614f595e0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:47.349806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-44b9906c-66ca-43af-8b6f-793b1cb80038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:47.349806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:47.349806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:47.349806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:47.349806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:47.349806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:47.349806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:47.349806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:47.349806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:47.349806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:47.349806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:47.349806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:47.349806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:47.349806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:47.349806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:47.350821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:47.351706 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:47.351706 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:47.351706 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:47.351706 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:47.352672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 486/990] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:32:47.358026 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:47.361428 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9906c-66ca-43af-8b6f-793b1cb80038 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:47.476428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221abeb0-2db7-43d9-b41e-924614f595e0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:47.489579 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9906c-66ca-43af-8b6f-793b1cb80038 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:47.525253 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934a40b-644a-4fbf-801c-358b4b9c8d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:47.526253 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:47.526369 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934a40b-644a-4fbf-801c-358b4b9c8d5d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:47.526879 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934a40b-644a-4fbf-801c-358b4b9c8d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:47.527364 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934a40b-644a-4fbf-801c-358b4b9c8d5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:47.528963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934a40b-644a-4fbf-801c-358b4b9c8d5d None admin] RBAC: Adding query filter params (interface=public, service_id=ec38d414881d48ea89c7adf0d463e8a3, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:47.529464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934a40b-644a-4fbf-801c-358b4b9c8d5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:47.532505 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934a40b-644a-4fbf-801c-358b4b9c8d5d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:47.533026 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1a6aa-7d25-4c80-8d3a-eacb3b5eb2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:47.534168 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1a6aa-7d25-4c80-8d3a-eacb3b5eb2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:47.534454 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1a6aa-7d25-4c80-8d3a-eacb3b5eb2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:47.534767 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1a6aa-7d25-4c80-8d3a-eacb3b5eb2b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:47.535542 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1a6aa-7d25-4c80-8d3a-eacb3b5eb2b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:47.535882 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1a6aa-7d25-4c80-8d3a-eacb3b5eb2b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:47.537265 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1a6aa-7d25-4c80-8d3a-eacb3b5eb2b3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:47.542857 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 505/991] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Jun 15 09:32:47 2022] GET /identity/v3/endpoints?service_id=ec38d414881d48ea89c7adf0d463e8a3&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:47.552266 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934a40b-644a-4fbf-801c-358b4b9c8d5d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:47.559405 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 487/992] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:47.560517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1a6aa-7d25-4c80-8d3a-eacb3b5eb2b3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:47.657865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:47.687963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934a40b-644a-4fbf-801c-358b4b9c8d5d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:47.717058 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1a6aa-7d25-4c80-8d3a-eacb3b5eb2b3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:47.731230 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb44aa4-35f5-4f77-8043-db25e5f2ab36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:47.731786 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb44aa4-35f5-4f77-8043-db25e5f2ab36 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:47.732078 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb44aa4-35f5-4f77-8043-db25e5f2ab36 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:47.732359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb44aa4-35f5-4f77-8043-db25e5f2ab36 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:47.733179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb44aa4-35f5-4f77-8043-db25e5f2ab36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:47.734568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb44aa4-35f5-4f77-8043-db25e5f2ab36 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:47.754537 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 506/993] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Jun 15 09:32:47 2022] GET /identity/v3/services => generated 1727 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 09:32:47.773838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7500a-972c-4db5-bac9-05e97118b18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:47.774816 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7500a-972c-4db5-bac9-05e97118b18c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:47.775162 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7500a-972c-4db5-bac9-05e97118b18c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:47.775500 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7500a-972c-4db5-bac9-05e97118b18c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:47.784724 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7500a-972c-4db5-bac9-05e97118b18c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:47.786370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7500a-972c-4db5-bac9-05e97118b18c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:47.803158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a0d7500a-972c-4db5-bac9-05e97118b18c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:47.803158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:47.803158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:47.803158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:47.803158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:47.803158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:47.803158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:47.803158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:47.803158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:47.803158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:47.803158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:47.803158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:47.803158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:47.803158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:47.803158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:47.811448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:47.813228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:47.813228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:47.813228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:47.813228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:47.813228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:47.813228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:47.813228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:47.813228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:47.813228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 488/994] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:47.818375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb44aa4-35f5-4f77-8043-db25e5f2ab36 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:47.958632 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb44aa4-35f5-4f77-8043-db25e5f2ab36 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:48.022048 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50224b-56ef-49c0-afee-20cd166dcb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:48.023190 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50224b-56ef-49c0-afee-20cd166dcb4c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:48.023698 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50224b-56ef-49c0-afee-20cd166dcb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:48.024189 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50224b-56ef-49c0-afee-20cd166dcb4c None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:48.025729 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50224b-56ef-49c0-afee-20cd166dcb4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:48.026325 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50224b-56ef-49c0-afee-20cd166dcb4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:48.029051 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50224b-56ef-49c0-afee-20cd166dcb4c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:48.043844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:48.060044 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 507/995] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:48.061220 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7500a-972c-4db5-bac9-05e97118b18c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:48.150655 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:48.246233 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7500a-972c-4db5-bac9-05e97118b18c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:48.300072 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95203aab-056a-4854-b2a1-a122b19e814a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:48.301187 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95203aab-056a-4854-b2a1-a122b19e814a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:48.301730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95203aab-056a-4854-b2a1-a122b19e814a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:48.302216 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95203aab-056a-4854-b2a1-a122b19e814a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:48.303292 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95203aab-056a-4854-b2a1-a122b19e814a None admin] RBAC: Adding query filter params (role.id=f81068136c064fa4a26cdb5606d27c4e, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=57632a25fe1f4b18b75e9774e87d8ffb) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:48.303839 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95203aab-056a-4854-b2a1-a122b19e814a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:48.305521 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95203aab-056a-4854-b2a1-a122b19e814a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:48.318748 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 489/996] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:32:48 2022] GET /identity/v3/role_assignments?user.id=57632a25fe1f4b18b75e9774e87d8ffb&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=f81068136c064fa4a26cdb5606d27c4e => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:49.113532 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f163c-bf4d-4b3a-affd-d30ab93f8360 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:49.114064 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f163c-bf4d-4b3a-affd-d30ab93f8360 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:49.114064 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f163c-bf4d-4b3a-affd-d30ab93f8360 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:49.115885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 508/997] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:49.124160 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62460e-775e-452c-a792-3ca516b45f79 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:49.124937 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62460e-775e-452c-a792-3ca516b45f79 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:49.124937 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62460e-775e-452c-a792-3ca516b45f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:49.143909 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ab62460e-775e-452c-a792-3ca516b45f79 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:49.145112 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ab62460e-775e-452c-a792-3ca516b45f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:49.233804 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 490/998] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:49.257747 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f163c-bf4d-4b3a-affd-d30ab93f8360 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:49.375091 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f163c-bf4d-4b3a-affd-d30ab93f8360 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:49.412514 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00820f7-0c61-4342-b62e-08062568b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:49.413334 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00820f7-0c61-4342-b62e-08062568b3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:49.413611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00820f7-0c61-4342-b62e-08062568b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:49.413945 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00820f7-0c61-4342-b62e-08062568b3c8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:49.414641 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00820f7-0c61-4342-b62e-08062568b3c8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:49.416078 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00820f7-0c61-4342-b62e-08062568b3c8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-b00820f7-0c61-4342-b62e-08062568b3c8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:49.433884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:49.441241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:49.442129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:49.442129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:49.442129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:49.442129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:49.442129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:49.442129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:49.442129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:49.442129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:49.442129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:49.442129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:49.442129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:49.442129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:49.442129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 09:32:49.442129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:49.442129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 509/999] 10.222.0.45 () {56 vars in 1126 bytes} [Wed Jun 15 09:32:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:32:49.444243 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62460e-775e-452c-a792-3ca516b45f79 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:49.494278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:49.586039 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62460e-775e-452c-a792-3ca516b45f79 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:49.635716 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a9767-204e-449b-aec5-9f078d7ec6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:49.636317 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a9767-204e-449b-aec5-9f078d7ec6cc None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:49.636600 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a9767-204e-449b-aec5-9f078d7ec6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:49.636880 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a9767-204e-449b-aec5-9f078d7ec6cc None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:49.637644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a9767-204e-449b-aec5-9f078d7ec6cc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:49.637952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a9767-204e-449b-aec5-9f078d7ec6cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:49.639440 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a9767-204e-449b-aec5-9f078d7ec6cc None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:49.646554 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 491/1000] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Jun 15 09:32:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:49.653154 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00820f7-0c61-4342-b62e-08062568b3c8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:49.781003 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:49.854773 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00820f7-0c61-4342-b62e-08062568b3c8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:49.920957 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eceb02-1fb0-4843-af03-39e839e4cbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:49.922029 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eceb02-1fb0-4843-af03-39e839e4cbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:49.922537 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eceb02-1fb0-4843-af03-39e839e4cbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:49.923036 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eceb02-1fb0-4843-af03-39e839e4cbe1 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:49.924379 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eceb02-1fb0-4843-af03-39e839e4cbe1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:49.924952 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eceb02-1fb0-4843-af03-39e839e4cbe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:49.927694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eceb02-1fb0-4843-af03-39e839e4cbe1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:49.942564 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 510/1001] 10.222.0.45 () {56 vars in 1122 bytes} [Wed Jun 15 09:32:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:49.947309 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a9767-204e-449b-aec5-9f078d7ec6cc None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:50.052081 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c42d6-e585-4e1a-8ae0-7c51c302743d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:50.052595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c42d6-e585-4e1a-8ae0-7c51c302743d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:50.053051 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c42d6-e585-4e1a-8ae0-7c51c302743d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:50.055771 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 511/1002] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:50.064587 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682177dc-9197-4246-893b-1cbc24dae4e2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:50.064910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682177dc-9197-4246-893b-1cbc24dae4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:50.065193 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682177dc-9197-4246-893b-1cbc24dae4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:50.092472 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-682177dc-9197-4246-893b-1cbc24dae4e2 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:50.094415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-682177dc-9197-4246-893b-1cbc24dae4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:50.155343 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a9767-204e-449b-aec5-9f078d7ec6cc None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:50.159482 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:50.215679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbe6ef-b7e8-40f5-8a2d-3a55ae74e7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:50.216268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbe6ef-b7e8-40f5-8a2d-3a55ae74e7ad None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:50.216557 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbe6ef-b7e8-40f5-8a2d-3a55ae74e7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:50.216839 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbe6ef-b7e8-40f5-8a2d-3a55ae74e7ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:50.217596 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbe6ef-b7e8-40f5-8a2d-3a55ae74e7ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:50.219113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbe6ef-b7e8-40f5-8a2d-3a55ae74e7ad None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:50.221204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 512/1003] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:50.237648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 492/1004] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Jun 15 09:32:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:32:50.254055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682177dc-9197-4246-893b-1cbc24dae4e2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:50.330355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:50.389097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682177dc-9197-4246-893b-1cbc24dae4e2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:50.440204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dca1e6-186a-4188-bd3f-717669bdaf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:50.441029 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dca1e6-186a-4188-bd3f-717669bdaf0e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:50.441315 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dca1e6-186a-4188-bd3f-717669bdaf0e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:50.441600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dca1e6-186a-4188-bd3f-717669bdaf0e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:50.442281 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dca1e6-186a-4188-bd3f-717669bdaf0e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:50.443760 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dca1e6-186a-4188-bd3f-717669bdaf0e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-55dca1e6-186a-4188-bd3f-717669bdaf0e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:50.457075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:50.459124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:50.461451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:50.461451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:50.461451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:50.461451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:50.461451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:50.461451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:50.461451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:50.461451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:50.461451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:50.461451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:50.461451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:50.461451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:50.461451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 09:32:50.461451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:50.464689 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbe6ef-b7e8-40f5-8a2d-3a55ae74e7ad None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:50.465182 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 513/1005] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:32:50.612043 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbe6ef-b7e8-40f5-8a2d-3a55ae74e7ad None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:50.654918 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85962d6e-8122-4313-8289-25f23e59e784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:50.655765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85962d6e-8122-4313-8289-25f23e59e784 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:50.656181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85962d6e-8122-4313-8289-25f23e59e784 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:50.656681 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85962d6e-8122-4313-8289-25f23e59e784 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:50.657588 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85962d6e-8122-4313-8289-25f23e59e784 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:50.658017 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85962d6e-8122-4313-8289-25f23e59e784 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:50.659685 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85962d6e-8122-4313-8289-25f23e59e784 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:50.669191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 493/1006] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Jun 15 09:32:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:50.671882 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dca1e6-186a-4188-bd3f-717669bdaf0e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:50.675789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be93fb-f12c-44c6-be9a-a55551a39ae8 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:50.676435 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be93fb-f12c-44c6-be9a-a55551a39ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:50.676809 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be93fb-f12c-44c6-be9a-a55551a39ae8 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:50.678803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 494/1007] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:32:50.687434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53baf6e-e653-46a8-a226-e421a543b9d7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:50.687890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53baf6e-e653-46a8-a226-e421a543b9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:50.688321 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53baf6e-e653-46a8-a226-e421a543b9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:50.713953 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b53baf6e-e653-46a8-a226-e421a543b9d7 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:50.715858 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b53baf6e-e653-46a8-a226-e421a543b9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:50.756107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:50.841762 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 495/1008] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:32:50.845037 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dca1e6-186a-4188-bd3f-717669bdaf0e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:50.867507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:50.881969 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53baf6e-e653-46a8-a226-e421a543b9d7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:50.894692 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf7df7-79dd-4fef-81a5-e26d7071d91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:50.895393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf7df7-79dd-4fef-81a5-e26d7071d91a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:50.895673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf7df7-79dd-4fef-81a5-e26d7071d91a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:50.895979 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf7df7-79dd-4fef-81a5-e26d7071d91a None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:50.896821 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf7df7-79dd-4fef-81a5-e26d7071d91a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:50.897141 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf7df7-79dd-4fef-81a5-e26d7071d91a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:50.898573 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf7df7-79dd-4fef-81a5-e26d7071d91a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:50.909069 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 514/1009] 10.222.0.45 () {56 vars in 1112 bytes} [Wed Jun 15 09:32:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:50.917275 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf7df7-79dd-4fef-81a5-e26d7071d91a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:51.059258 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53baf6e-e653-46a8-a226-e421a543b9d7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:51.090102 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf7df7-79dd-4fef-81a5-e26d7071d91a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:51.124567 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b58a4-86a3-4f19-aec2-7119ee1c2458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:51.125785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b58a4-86a3-4f19-aec2-7119ee1c2458 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:51.126285 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b58a4-86a3-4f19-aec2-7119ee1c2458 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:51.126873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b58a4-86a3-4f19-aec2-7119ee1c2458 None admin] PATH_INFO: `/v3/services/image` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:51.128141 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b58a4-86a3-4f19-aec2-7119ee1c2458 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:51.130821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b58a4-86a3-4f19-aec2-7119ee1c2458 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:51.138034 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c5feb-af40-4a44-807e-f75883dd919b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:51.139321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c5feb-af40-4a44-807e-f75883dd919b None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:51.139796 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c5feb-af40-4a44-807e-f75883dd919b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:51.140290 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c5feb-af40-4a44-807e-f75883dd919b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:51.141227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c5feb-af40-4a44-807e-f75883dd919b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:51.143378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c5feb-af40-4a44-807e-f75883dd919b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-513b58a4-86a3-4f19-aec2-7119ee1c2458 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:51.155413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:51.158392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:51.161235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:51.161235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:51.161235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:51.161235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:51.161235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:51.161235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:51.161235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:51.161235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:51.161235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:51.161235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:51.161235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:51.161235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:51.161235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 09:32:51.161235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:51.161235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 496/1010] 10.222.0.45 () {56 vars in 1105 bytes} [Wed Jun 15 09:32:50 2022] GET /identity/v3/services/image => generated 86 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:32:51.169906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b58a4-86a3-4f19-aec2-7119ee1c2458 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:51.174090 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 515/1011] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Jun 15 09:32:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 09:32:51.220731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:51.364443 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b58a4-86a3-4f19-aec2-7119ee1c2458 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:51.431803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0ef66-d503-479d-afdf-bac415bfd90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:51.432772 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0ef66-d503-479d-afdf-bac415bfd90e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:51.433166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0ef66-d503-479d-afdf-bac415bfd90e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:51.433599 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0ef66-d503-479d-afdf-bac415bfd90e None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:51.434804 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0ef66-d503-479d-afdf-bac415bfd90e None admin] RBAC: Adding query filter params (name=image) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:51.435236 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0ef66-d503-479d-afdf-bac415bfd90e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:51.436830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0ef66-d503-479d-afdf-bac415bfd90e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:51.444763 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 497/1012] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:51.454799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c5feb-af40-4a44-807e-f75883dd919b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:51.509491 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:51.644383 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c5feb-af40-4a44-807e-f75883dd919b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:51.705508 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8290c-a752-4f4f-8fe4-78458060577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:51.706367 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8290c-a752-4f4f-8fe4-78458060577a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:51.706810 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8290c-a752-4f4f-8fe4-78458060577a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:51.707263 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8290c-a752-4f4f-8fe4-78458060577a None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:51.708322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8290c-a752-4f4f-8fe4-78458060577a None admin] RBAC: Adding query filter params (type=image) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:51.708840 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8290c-a752-4f4f-8fe4-78458060577a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:51.710373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8290c-a752-4f4f-8fe4-78458060577a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:51.716336 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 516/1013] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:52.925778 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170873c-9d57-45fa-9827-11e246dc1a6f None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:52.926808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170873c-9d57-45fa-9827-11e246dc1a6f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:52.926808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170873c-9d57-45fa-9827-11e246dc1a6f None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:52.927987 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 498/1014] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:32:52.933902 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38974f-2050-47df-b150-96e4acc6bb01 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:52.934728 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38974f-2050-47df-b150-96e4acc6bb01 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:52.934728 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38974f-2050-47df-b150-96e4acc6bb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:52.953558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ce38974f-2050-47df-b150-96e4acc6bb01 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:52.955370 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ce38974f-2050-47df-b150-96e4acc6bb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:53.033122 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 517/1015] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:52 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:53.057442 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170873c-9d57-45fa-9827-11e246dc1a6f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:53.208550 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:53.233376 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170873c-9d57-45fa-9827-11e246dc1a6f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:53.292632 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d33e9a-4437-4f17-85d8-1b232bd42661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:53.294049 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d33e9a-4437-4f17-85d8-1b232bd42661 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:53.294558 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d33e9a-4437-4f17-85d8-1b232bd42661 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:53.295047 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d33e9a-4437-4f17-85d8-1b232bd42661 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:53.297274 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d33e9a-4437-4f17-85d8-1b232bd42661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:53.300117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d33e9a-4437-4f17-85d8-1b232bd42661 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:53.303507 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 499/1016] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:53.312872 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38974f-2050-47df-b150-96e4acc6bb01 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:53.371124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:53.510205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38974f-2050-47df-b150-96e4acc6bb01 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:53.582884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16e1c7-9785-4fa3-a634-9befe89ecf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:53.584007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16e1c7-9785-4fa3-a634-9befe89ecf73 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:53.584502 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16e1c7-9785-4fa3-a634-9befe89ecf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:53.584978 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16e1c7-9785-4fa3-a634-9befe89ecf73 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:53.586317 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16e1c7-9785-4fa3-a634-9befe89ecf73 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:53.589099 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16e1c7-9785-4fa3-a634-9befe89ecf73 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:53.639673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 518/1017] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Jun 15 09:32:53 2022] POST /identity/v3/projects => generated 311 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:32:54.061092 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe3128-e1e4-4867-8045-481c30751958 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:54.061909 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe3128-e1e4-4867-8045-481c30751958 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:54.061909 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe3128-e1e4-4867-8045-481c30751958 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:54.063874 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 500/1018] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:32:54.069343 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde1eab-c15b-415d-88d0-185500927f4c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:54.070094 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde1eab-c15b-415d-88d0-185500927f4c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:54.070094 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde1eab-c15b-415d-88d0-185500927f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:54.089410 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bbde1eab-c15b-415d-88d0-185500927f4c None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:54.090852 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bbde1eab-c15b-415d-88d0-185500927f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:54.174537 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 519/1019] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:54 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:54.217393 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe3128-e1e4-4867-8045-481c30751958 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:54.285821 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c691de-8435-4c28-893b-f5d9fd2b6519 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:54.286423 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c691de-8435-4c28-893b-f5d9fd2b6519 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:54.286999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c691de-8435-4c28-893b-f5d9fd2b6519 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:54.288539 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 520/1020] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:32:54.296558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196f0a6-f4d3-4306-b6f6-c49c9953cf30 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:54.297149 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196f0a6-f4d3-4306-b6f6-c49c9953cf30 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:54.298139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196f0a6-f4d3-4306-b6f6-c49c9953cf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:54.317187 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c196f0a6-f4d3-4306-b6f6-c49c9953cf30 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:54.318863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c196f0a6-f4d3-4306-b6f6-c49c9953cf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:54.329286 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:54.363329 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe3128-e1e4-4867-8045-481c30751958 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:54.404889 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 521/1021] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:54 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:54.416284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b15eb1-0337-4a22-8ebc-11d055f16802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:54.416972 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15eb1-0337-4a22-8ebc-11d055f16802 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:54.417260 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15eb1-0337-4a22-8ebc-11d055f16802 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:54.417542 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15eb1-0337-4a22-8ebc-11d055f16802 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:54.418272 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b15eb1-0337-4a22-8ebc-11d055f16802 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:54.419812 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b15eb1-0337-4a22-8ebc-11d055f16802 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:54.435334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 501/1022] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Jun 15 09:32:54 2022] POST /identity/v3/services => generated 242 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:32:54.447799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196f0a6-f4d3-4306-b6f6-c49c9953cf30 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:54.629437 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196f0a6-f4d3-4306-b6f6-c49c9953cf30 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:54.712299 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65bf85-fbd8-4beb-a804-dddb825e628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:54.713769 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65bf85-fbd8-4beb-a804-dddb825e628c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:54.714278 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65bf85-fbd8-4beb-a804-dddb825e628c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:54.714815 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65bf85-fbd8-4beb-a804-dddb825e628c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:54.729723 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:54.739309 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65bf85-fbd8-4beb-a804-dddb825e628c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ce65bf85-fbd8-4beb-a804-dddb825e628c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:32:54.757055 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:54.759170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:54.761607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:54.761607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:54.761607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:54.761607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:54.761607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:32:54.761607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:32:54.761607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:32:54.761607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:32:54.761607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:32:54.761607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:32:54.761607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 09:32:54.761607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:54.761607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 522/1023] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Jun 15 09:32:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:54.768629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b15eb1-0337-4a22-8ebc-11d055f16802 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:54.791031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:54.967477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b15eb1-0337-4a22-8ebc-11d055f16802 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:55.032208 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d90031-ec9e-454c-92ad-a4511ea81f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:55.033381 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d90031-ec9e-454c-92ad-a4511ea81f7a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:55.033894 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d90031-ec9e-454c-92ad-a4511ea81f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:55.034401 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d90031-ec9e-454c-92ad-a4511ea81f7a None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:55.035742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d90031-ec9e-454c-92ad-a4511ea81f7a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:55.036315 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d90031-ec9e-454c-92ad-a4511ea81f7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:55.039021 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d90031-ec9e-454c-92ad-a4511ea81f7a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:55.062557 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 502/1024] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Jun 15 09:32:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:55.066489 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65bf85-fbd8-4beb-a804-dddb825e628c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:55.262999 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65bf85-fbd8-4beb-a804-dddb825e628c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:55.307031 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d046d-68fb-4f89-b536-e71027b983ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:55.307876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d046d-68fb-4f89-b536-e71027b983ea None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:55.308157 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d046d-68fb-4f89-b536-e71027b983ea None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:55.308434 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d046d-68fb-4f89-b536-e71027b983ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:55.323082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d046d-68fb-4f89-b536-e71027b983ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:55.324587 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d046d-68fb-4f89-b536-e71027b983ea None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:55.345127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ee0d046d-68fb-4f89-b536-e71027b983ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:55.345127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:55.345127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:55.345127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:55.345127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:55.345127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:55.345127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:55.345127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:55.345127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:55.345127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:55.345127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:55.345127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:55.345127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:55.345127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:55.345127 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:55.352007 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:55.353770 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:55.353770 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:55.353770 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:55.353770 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:55.353770 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 523/1025] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:55.358798 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d90031-ec9e-454c-92ad-a4511ea81f7a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:55.483107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:55.534183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d90031-ec9e-454c-92ad-a4511ea81f7a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:55.578464 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ba261-5efd-4884-a5cc-9abf557a7c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:55.579821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba261-5efd-4884-a5cc-9abf557a7c0c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:55.580230 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba261-5efd-4884-a5cc-9abf557a7c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:55.580646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ba261-5efd-4884-a5cc-9abf557a7c0c None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:55.581516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ba261-5efd-4884-a5cc-9abf557a7c0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:55.581952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ba261-5efd-4884-a5cc-9abf557a7c0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:55.583482 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ba261-5efd-4884-a5cc-9abf557a7c0c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:55.601855 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 503/1026] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:55.603661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d046d-68fb-4f89-b536-e71027b983ea None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:55.698527 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:55.771831 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d046d-68fb-4f89-b536-e71027b983ea None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:55.810792 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722b6db-37cb-4b92-ab1f-9758bc1442fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:55.811493 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722b6db-37cb-4b92-ab1f-9758bc1442fc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:55.811778 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722b6db-37cb-4b92-ab1f-9758bc1442fc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:55.812048 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722b6db-37cb-4b92-ab1f-9758bc1442fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:55.821508 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722b6db-37cb-4b92-ab1f-9758bc1442fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:55.823006 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722b6db-37cb-4b92-ab1f-9758bc1442fc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8722b6db-37cb-4b92-ab1f-9758bc1442fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:32:55.838185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:55.847719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:55.849920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:55.849920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:55.849920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:32:55.849920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:32:55.849920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:32:55.849920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:32:55.849920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:32:55.849920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:32:55.849920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:32:55.849920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:55.849920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 524/1027] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Jun 15 09:32:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:32:55.853539 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ba261-5efd-4884-a5cc-9abf557a7c0c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:55.968373 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ba261-5efd-4884-a5cc-9abf557a7c0c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:56.003736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:56.011491 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9fe32-ee12-487b-91ac-401cdfa4175b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:56.012326 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9fe32-ee12-487b-91ac-401cdfa4175b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:56.012708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9fe32-ee12-487b-91ac-401cdfa4175b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:56.013083 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9fe32-ee12-487b-91ac-401cdfa4175b None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:56.014065 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9fe32-ee12-487b-91ac-401cdfa4175b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:56.014476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9fe32-ee12-487b-91ac-401cdfa4175b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:56.016116 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9fe32-ee12-487b-91ac-401cdfa4175b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:56.037530 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 504/1028] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Jun 15 09:32:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:56.043798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722b6db-37cb-4b92-ab1f-9758bc1442fc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:56.202990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722b6db-37cb-4b92-ab1f-9758bc1442fc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:56.217456 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:56.247169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35475a7-0f03-46ab-a089-2a1ce933bdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:56.247829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35475a7-0f03-46ab-a089-2a1ce933bdce None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:56.248130 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35475a7-0f03-46ab-a089-2a1ce933bdce None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:56.248380 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35475a7-0f03-46ab-a089-2a1ce933bdce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:56.327852 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35475a7-0f03-46ab-a089-2a1ce933bdce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:56.329375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35475a7-0f03-46ab-a089-2a1ce933bdce None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:56.445085 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 525/1029] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:32:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 09:32:56.451453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9fe32-ee12-487b-91ac-401cdfa4175b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:56.638737 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9fe32-ee12-487b-91ac-401cdfa4175b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:56.698052 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7942b-aa77-4d1a-8772-cb368276a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:56.699340 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7942b-aa77-4d1a-8772-cb368276a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:56.699780 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7942b-aa77-4d1a-8772-cb368276a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:56.700208 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7942b-aa77-4d1a-8772-cb368276a2e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:56.700544 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedec493-31fb-4798-ba4e-b2d21f23a883 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:56.700837 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedec493-31fb-4798-ba4e-b2d21f23a883 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:56.701219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedec493-31fb-4798-ba4e-b2d21f23a883 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:56.702775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 526/1030] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:56.709011 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0ebfb-85f9-4bda-a902-20b936242f95 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:56.709304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0ebfb-85f9-4bda-a902-20b936242f95 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:56.709578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0ebfb-85f9-4bda-a902-20b936242f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:56.717254 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7942b-aa77-4d1a-8772-cb368276a2e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:56.718789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7942b-aa77-4d1a-8772-cb368276a2e8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:56.730959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-37c0ebfb-85f9-4bda-a902-20b936242f95 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:56.732180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-37c0ebfb-85f9-4bda-a902-20b936242f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:56.737026 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:56.738538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-43f7942b-aa77-4d1a-8772-cb368276a2e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:56.738538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:56.738538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:56.738538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:56.738538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:56.738538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:56.738538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:56.738538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:56.738538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:56.738538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:56.738538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:56.738538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:56.738538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:32:56.738538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:32:56.738538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:56.740098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:56.741758 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:32:56.741758 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:32:56.741758 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:32:56.741758 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:56.741758 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 505/1031] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:32:56.745721 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7942b-aa77-4d1a-8772-cb368276a2e8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:56.806299 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:56.824631 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 527/1032] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:32:56.847594 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0ebfb-85f9-4bda-a902-20b936242f95 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:56.876037 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7942b-aa77-4d1a-8772-cb368276a2e8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:56.924053 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6074c4-e351-48d9-9d9b-46d00d6663ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:56.924786 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6074c4-e351-48d9-9d9b-46d00d6663ba None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:56.925086 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6074c4-e351-48d9-9d9b-46d00d6663ba None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:56.925344 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6074c4-e351-48d9-9d9b-46d00d6663ba None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:56.926104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6074c4-e351-48d9-9d9b-46d00d6663ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:56.926418 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6074c4-e351-48d9-9d9b-46d00d6663ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:56.927913 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6074c4-e351-48d9-9d9b-46d00d6663ba None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:56.949796 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 506/1033] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:56.951168 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6074c4-e351-48d9-9d9b-46d00d6663ba None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:56.984497 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0ebfb-85f9-4bda-a902-20b936242f95 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:57.034610 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8854b24-f036-45af-a9d9-ab16f1e51924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:57.035816 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8854b24-f036-45af-a9d9-ab16f1e51924 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:57.036321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8854b24-f036-45af-a9d9-ab16f1e51924 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:57.036658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8854b24-f036-45af-a9d9-ab16f1e51924 None admin] PATH_INFO: `/v3/services/image` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:57.037797 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8854b24-f036-45af-a9d9-ab16f1e51924 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:57.040234 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8854b24-f036-45af-a9d9-ab16f1e51924 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c8854b24-f036-45af-a9d9-ab16f1e51924 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:57.060606 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:57.063118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:57.065577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:57.065577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:57.065577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:57.065577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:57.065577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:57.065577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:57.065577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:57.065577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:57.065577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:57.065577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:57.065577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:32:57.065577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:32:57.065577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 09:32:57.065577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:32:57.065577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 528/1034] 10.222.0.45 () {56 vars in 1105 bytes} [Wed Jun 15 09:32:56 2022] GET /identity/v3/services/image => generated 86 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:32:57.068718 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecab8aa-d856-4822-baed-b9cea2485d1b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:57.068718 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecab8aa-d856-4822-baed-b9cea2485d1b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:57.068718 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecab8aa-d856-4822-baed-b9cea2485d1b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:57.068718 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 529/1035] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:32:57.071673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecab8aa-d856-4822-baed-b9cea2485d1b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:57.076175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:57.104318 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6074c4-e351-48d9-9d9b-46d00d6663ba None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:57.107338 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:57.175046 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154a256-45c3-4825-8bb4-eb12b59b4435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:57.176299 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154a256-45c3-4825-8bb4-eb12b59b4435 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:57.176811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154a256-45c3-4825-8bb4-eb12b59b4435 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:57.177325 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154a256-45c3-4825-8bb4-eb12b59b4435 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:57.189834 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154a256-45c3-4825-8bb4-eb12b59b4435 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:57.191449 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154a256-45c3-4825-8bb4-eb12b59b4435 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:57.205187 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecab8aa-d856-4822-baed-b9cea2485d1b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:57.212760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b154a256-45c3-4825-8bb4-eb12b59b4435 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:57.212760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:32:57.212760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:32:57.212760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:32:57.212760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:32:57.212760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:32:57.212760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:32:57.212760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:32:57.212760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:32:57.212760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:32:57.212760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:32:57.212760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:32:57.212760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:32:57.212760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:32:57.212760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:32:57.214453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:32:57.215854 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:32:57.215854 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:32:57.215854 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:32:57.215854 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:32:57.215854 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:32:57.215854 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:32:57.215854 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:32:57.215854 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:32:57.215854 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 507/1036] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:32:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:32:57.215854 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eb736-0881-466f-ab22-0158165e879a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:57.215854 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eb736-0881-466f-ab22-0158165e879a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:57.216492 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eb736-0881-466f-ab22-0158165e879a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:57.235726 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-160eb736-0881-466f-ab22-0158165e879a None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:32:57.237089 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-160eb736-0881-466f-ab22-0158165e879a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:32:57.253878 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3c120-49d4-4b68-9df9-213be4c72eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:57.255078 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3c120-49d4-4b68-9df9-213be4c72eee None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:57.255578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3c120-49d4-4b68-9df9-213be4c72eee None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:57.256057 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3c120-49d4-4b68-9df9-213be4c72eee None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:57.257409 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3c120-49d4-4b68-9df9-213be4c72eee None admin] RBAC: Adding query filter params (name=image) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:57.257961 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3c120-49d4-4b68-9df9-213be4c72eee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:57.260827 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3c120-49d4-4b68-9df9-213be4c72eee None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:57.269843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 530/1037] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:57.271036 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3c120-49d4-4b68-9df9-213be4c72eee None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:57.314316 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 508/1038] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:32:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:32:57.315861 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eb736-0881-466f-ab22-0158165e879a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:57.374152 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:57.423280 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3c120-49d4-4b68-9df9-213be4c72eee None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:57.436789 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:57.448006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eb736-0881-466f-ab22-0158165e879a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:57.478129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b8517-c3c8-42bc-b1db-ca34c577af16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:57.479378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b8517-c3c8-42bc-b1db-ca34c577af16 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:57.479882 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b8517-c3c8-42bc-b1db-ca34c577af16 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:57.480370 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b8517-c3c8-42bc-b1db-ca34c577af16 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:57.481663 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b8517-c3c8-42bc-b1db-ca34c577af16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:57.482213 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b8517-c3c8-42bc-b1db-ca34c577af16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:57.485507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b8517-c3c8-42bc-b1db-ca34c577af16 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:57.494382 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf59d8b-fa87-4dc3-93bf-b989badcf3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:57.495305 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf59d8b-fa87-4dc3-93bf-b989badcf3df None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:57.495659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf59d8b-fa87-4dc3-93bf-b989badcf3df None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:57.495987 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf59d8b-fa87-4dc3-93bf-b989badcf3df None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:57.496832 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf59d8b-fa87-4dc3-93bf-b989badcf3df None admin] RBAC: Adding query filter params (type=image) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:57.497182 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf59d8b-fa87-4dc3-93bf-b989badcf3df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:57.498753 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf59d8b-fa87-4dc3-93bf-b989badcf3df None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:57.506379 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 509/1039] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:57.507916 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf59d8b-fa87-4dc3-93bf-b989badcf3df None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:57.514644 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 531/1040] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:32:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:57.516018 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b8517-c3c8-42bc-b1db-ca34c577af16 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:57.637301 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf59d8b-fa87-4dc3-93bf-b989badcf3df None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:57.651517 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b8517-c3c8-42bc-b1db-ca34c577af16 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:57.682824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:57.690744 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39542f-ee30-4c7c-9cd0-2926177c411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:57.692161 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39542f-ee30-4c7c-9cd0-2926177c411b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:57.692672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39542f-ee30-4c7c-9cd0-2926177c411b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:57.693173 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39542f-ee30-4c7c-9cd0-2926177c411b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:57.693562 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63870add-d703-4636-8b4e-73ad9f8370e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:57.694394 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63870add-d703-4636-8b4e-73ad9f8370e0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:57.694825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63870add-d703-4636-8b4e-73ad9f8370e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:57.695212 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63870add-d703-4636-8b4e-73ad9f8370e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:57.695369 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39542f-ee30-4c7c-9cd0-2926177c411b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:57.696215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63870add-d703-4636-8b4e-73ad9f8370e0 None admin] RBAC: Adding query filter params (interface=public, service_id=161c523629114f259e47d472b413f52a, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:57.696654 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63870add-d703-4636-8b4e-73ad9f8370e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:57.698003 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39542f-ee30-4c7c-9cd0-2926177c411b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:57.698139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63870add-d703-4636-8b4e-73ad9f8370e0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:57.700823 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 510/1041] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:32:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:57.702324 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39542f-ee30-4c7c-9cd0-2926177c411b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:57.704461 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 532/1042] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Jun 15 09:32:57 2022] GET /identity/v3/endpoints?service_id=161c523629114f259e47d472b413f52a&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:32:57.708032 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63870add-d703-4636-8b4e-73ad9f8370e0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:57.736205 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:57.832031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39542f-ee30-4c7c-9cd0-2926177c411b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:57.846136 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63870add-d703-4636-8b4e-73ad9f8370e0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:57.885637 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b42fe1-bffa-4b9b-b98a-dad31df9aea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:57.886325 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b42fe1-bffa-4b9b-b98a-dad31df9aea1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:57.886718 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b42fe1-bffa-4b9b-b98a-dad31df9aea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:57.887042 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b42fe1-bffa-4b9b-b98a-dad31df9aea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:57.888270 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b42fe1-bffa-4b9b-b98a-dad31df9aea1 None admin] RBAC: Adding query filter params (role.id=f81068136c064fa4a26cdb5606d27c4e, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=26dbaf7292444c8f9a6d45bfaf96763f) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:32:57.888580 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b42fe1-bffa-4b9b-b98a-dad31df9aea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:57.889184 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d39d4-deed-4c5b-a177-9804e76f70a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:57.889864 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d39d4-deed-4c5b-a177-9804e76f70a3 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:57.890144 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d39d4-deed-4c5b-a177-9804e76f70a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:57.890420 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d39d4-deed-4c5b-a177-9804e76f70a3 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:57.891301 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b42fe1-bffa-4b9b-b98a-dad31df9aea1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:57.891715 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d39d4-deed-4c5b-a177-9804e76f70a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:57.893139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d39d4-deed-4c5b-a177-9804e76f70a3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:57.907655 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 511/1043] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:32:57 2022] GET /identity/v3/role_assignments?user.id=26dbaf7292444c8f9a6d45bfaf96763f&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=f81068136c064fa4a26cdb5606d27c4e => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:32:57.907655 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b42fe1-bffa-4b9b-b98a-dad31df9aea1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:32:57.921725 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 533/1044] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:32:57 2022] POST /identity/v3/users => generated 285 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 09:32:58.092013 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:32:58.118485 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b42fe1-bffa-4b9b-b98a-dad31df9aea1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:32:58.184672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1cb96-e161-42fb-a239-383dc85c8c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:32:58.185777 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1cb96-e161-42fb-a239-383dc85c8c3b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:32:58.186304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1cb96-e161-42fb-a239-383dc85c8c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:32:58.186897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1cb96-e161-42fb-a239-383dc85c8c3b None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:32:58.188111 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1cb96-e161-42fb-a239-383dc85c8c3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:32:58.190517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1cb96-e161-42fb-a239-383dc85c8c3b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:32:58.204391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 512/1045] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Jun 15 09:32:57 2022] GET /identity/v3/services => generated 1957 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 09:33:00.158173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98aaac4-5e4f-4b0e-9898-caa2a9f5abeb None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:00.159134 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98aaac4-5e4f-4b0e-9898-caa2a9f5abeb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:00.159134 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98aaac4-5e4f-4b0e-9898-caa2a9f5abeb None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:00.160421 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 534/1046] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:00.166199 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fbe2a-8e14-4491-b17f-d5d9893539b7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:00.167098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fbe2a-8e14-4491-b17f-d5d9893539b7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:00.167098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fbe2a-8e14-4491-b17f-d5d9893539b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:00.185645 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bc6fbe2a-8e14-4491-b17f-d5d9893539b7 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:00.186889 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bc6fbe2a-8e14-4491-b17f-d5d9893539b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:00.209581 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e6ebb-9676-4e0e-9717-6be92fc9a5ff None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:00.209886 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e6ebb-9676-4e0e-9717-6be92fc9a5ff None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:00.210128 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e6ebb-9676-4e0e-9717-6be92fc9a5ff None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:00.212485 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 535/1047] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:33:00.222255 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca62f4-ddf2-46b0-aebf-8c2d20d5195c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:00.222591 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca62f4-ddf2-46b0-aebf-8c2d20d5195c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:00.222867 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca62f4-ddf2-46b0-aebf-8c2d20d5195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:00.240442 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-20ca62f4-ddf2-46b0-aebf-8c2d20d5195c None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:00.241649 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-20ca62f4-ddf2-46b0-aebf-8c2d20d5195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:00.289994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 513/1048] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:33:00.297752 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:00.327631 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 536/1049] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:33:00.330625 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fbe2a-8e14-4491-b17f-d5d9893539b7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:00.350455 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca62f4-ddf2-46b0-aebf-8c2d20d5195c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:00.458588 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:00.481421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fbe2a-8e14-4491-b17f-d5d9893539b7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:00.507702 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca62f4-ddf2-46b0-aebf-8c2d20d5195c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:00.522919 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df4fe3-8cea-42ab-b497-4d7d88222dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:00.523779 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df4fe3-8cea-42ab-b497-4d7d88222dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:00.524063 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df4fe3-8cea-42ab-b497-4d7d88222dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:00.524343 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df4fe3-8cea-42ab-b497-4d7d88222dd0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:00.537400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df4fe3-8cea-42ab-b497-4d7d88222dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-62df4fe3-8cea-42ab-b497-4d7d88222dd0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:33:00.546191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:00.548755 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:00.551422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:00.551422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:00.551422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:00.551422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:00.551422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:33:00.551422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:33:00.551422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:33:00.551422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:33:00.551422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:33:00.551422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:33:00.551422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 09:33:00.551422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:00.551422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 514/1050] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Jun 15 09:33:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:00.551422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cde1a-d246-4f9e-b60f-a5a46de6dd49 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:00.554748 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cde1a-d246-4f9e-b60f-a5a46de6dd49 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:00.554748 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cde1a-d246-4f9e-b60f-a5a46de6dd49 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:00.554748 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 515/1051] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:00.557697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cde1a-d246-4f9e-b60f-a5a46de6dd49 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:00.574121 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880bed1-26ba-423e-a30b-19a54f021128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:00.575419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880bed1-26ba-423e-a30b-19a54f021128 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:00.575873 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880bed1-26ba-423e-a30b-19a54f021128 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:00.576335 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880bed1-26ba-423e-a30b-19a54f021128 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:00.595582 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880bed1-26ba-423e-a30b-19a54f021128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6880bed1-26ba-423e-a30b-19a54f021128 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:33:00.609976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:00.611183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:00.612063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:00.612063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:00.612063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:00.612063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:00.612063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:33:00.612063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:33:00.612063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:33:00.612063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:33:00.612063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:33:00.612063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:33:00.612063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:00.612063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:33:00.612733 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 537/1052] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:33:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:33:00.614204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359d031-110e-4488-bf97-24ea0991a053 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:00.614569 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359d031-110e-4488-bf97-24ea0991a053 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:00.614902 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359d031-110e-4488-bf97-24ea0991a053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:00.635931 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f359d031-110e-4488-bf97-24ea0991a053 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:00.637340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f359d031-110e-4488-bf97-24ea0991a053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:00.677675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:00.702291 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cde1a-d246-4f9e-b60f-a5a46de6dd49 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:00.722742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 538/1053] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:00.723493 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359d031-110e-4488-bf97-24ea0991a053 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:00.758034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad8562-4ff0-4eb0-b692-003d6ef91d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:00.760435 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad8562-4ff0-4eb0-b692-003d6ef91d7a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:00.760916 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad8562-4ff0-4eb0-b692-003d6ef91d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:00.761379 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad8562-4ff0-4eb0-b692-003d6ef91d7a None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:00.762750 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad8562-4ff0-4eb0-b692-003d6ef91d7a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:00.763262 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad8562-4ff0-4eb0-b692-003d6ef91d7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:00.765766 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad8562-4ff0-4eb0-b692-003d6ef91d7a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:00.782388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 516/1054] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Jun 15 09:33:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:33:00.783889 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad8562-4ff0-4eb0-b692-003d6ef91d7a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:00.789103 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:00.865963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359d031-110e-4488-bf97-24ea0991a053 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:00.901446 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad8562-4ff0-4eb0-b692-003d6ef91d7a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:00.922341 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e72a4-5bcf-4919-90fd-3e419d7ad52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:00.923059 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e72a4-5bcf-4919-90fd-3e419d7ad52b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:00.923344 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e72a4-5bcf-4919-90fd-3e419d7ad52b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:00.923624 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e72a4-5bcf-4919-90fd-3e419d7ad52b None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:00.924391 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e72a4-5bcf-4919-90fd-3e419d7ad52b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:00.924700 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e72a4-5bcf-4919-90fd-3e419d7ad52b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:00.926097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e72a4-5bcf-4919-90fd-3e419d7ad52b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:00.935511 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 539/1055] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:33:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:00.936128 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e72a4-5bcf-4919-90fd-3e419d7ad52b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:00.950630 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd85f1f-a850-4f00-82e9-7616c1a1e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:00.951963 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd85f1f-a850-4f00-82e9-7616c1a1e789 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:00.952466 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd85f1f-a850-4f00-82e9-7616c1a1e789 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:00.953434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd85f1f-a850-4f00-82e9-7616c1a1e789 None admin] PATH_INFO: `/v3/services/image` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:00.954713 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd85f1f-a850-4f00-82e9-7616c1a1e789 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:00.957323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd85f1f-a850-4f00-82e9-7616c1a1e789 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:00.971382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9bd85f1f-a850-4f00-82e9-7616c1a1e789 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:00.979977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:00.981225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:00.982098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:00.982098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:00.982098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:00.982098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:00.982098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:00.982098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:00.982098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:00.982098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:00.982098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:00.982098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:00.982098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:33:00.982098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:33:00.982098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 09:33:00.982098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:00.983002 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 517/1056] 10.222.0.45 () {56 vars in 1105 bytes} [Wed Jun 15 09:33:00 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:00.984347 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd85f1f-a850-4f00-82e9-7616c1a1e789 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:01.078377 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e72a4-5bcf-4919-90fd-3e419d7ad52b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:01.097732 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:01.120429 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f2a30-c23d-4a05-af65-4c9602160a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:01.121394 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f2a30-c23d-4a05-af65-4c9602160a78 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:01.121578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f2a30-c23d-4a05-af65-4c9602160a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:01.121825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f2a30-c23d-4a05-af65-4c9602160a78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:01.136084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f2a30-c23d-4a05-af65-4c9602160a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:01.137904 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198f2a30-c23d-4a05-af65-4c9602160a78 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:01.160173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-198f2a30-c23d-4a05-af65-4c9602160a78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:33:01.160173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:01.160173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:01.160173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:01.160173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:01.160173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:01.160173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:01.160173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:01.160173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:01.160173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:01.160173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:01.160173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:01.160173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:33:01.160173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:33:01.160173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:01.161661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:01.162642 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:33:01.162642 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:33:01.162642 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:33:01.162642 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:33:01.162642 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 540/1057] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:01.162642 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f2a30-c23d-4a05-af65-4c9602160a78 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:01.174416 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd85f1f-a850-4f00-82e9-7616c1a1e789 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:01.240519 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55ef73-bb57-4737-9f91-6daef24da6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:01.241976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55ef73-bb57-4737-9f91-6daef24da6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:01.242480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55ef73-bb57-4737-9f91-6daef24da6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:01.243012 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55ef73-bb57-4737-9f91-6daef24da6a4 None admin] PATH_INFO: `/v3/users/cc713721724545afa118f37a596a98b7` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:01.267521 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55ef73-bb57-4737-9f91-6daef24da6a4 None admin] RBAC: Authorizing `identity:get_user(user_id=cc713721724545afa118f37a596a98b7)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:01.269696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55ef73-bb57-4737-9f91-6daef24da6a4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:01.271643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 518/1058] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:33:00 2022] GET /identity/v3/users/cc713721724545afa118f37a596a98b7 => generated 285 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:01.272557 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55ef73-bb57-4737-9f91-6daef24da6a4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:01.279951 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:01.295011 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f2a30-c23d-4a05-af65-4c9602160a78 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:01.335480 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ec18f-1725-4f85-9e5e-0783c3bca7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:01.336177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ec18f-1725-4f85-9e5e-0783c3bca7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:01.336503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ec18f-1725-4f85-9e5e-0783c3bca7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:01.336750 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ec18f-1725-4f85-9e5e-0783c3bca7d2 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:01.337479 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ec18f-1725-4f85-9e5e-0783c3bca7d2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:01.337793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ec18f-1725-4f85-9e5e-0783c3bca7d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:01.339222 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ec18f-1725-4f85-9e5e-0783c3bca7d2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:01.344755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 541/1059] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:33:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:01.345617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ec18f-1725-4f85-9e5e-0783c3bca7d2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:01.420295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55ef73-bb57-4737-9f91-6daef24da6a4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:01.450746 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:01.465906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da334f-41a1-4e28-82df-56faa81c2846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:01.467213 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da334f-41a1-4e28-82df-56faa81c2846 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:01.467678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da334f-41a1-4e28-82df-56faa81c2846 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:01.468190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da334f-41a1-4e28-82df-56faa81c2846 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:01.469599 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da334f-41a1-4e28-82df-56faa81c2846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:01.470176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da334f-41a1-4e28-82df-56faa81c2846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:01.472783 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da334f-41a1-4e28-82df-56faa81c2846 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:01.475453 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ec18f-1725-4f85-9e5e-0783c3bca7d2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:01.499458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 519/1060] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:01.499458 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da334f-41a1-4e28-82df-56faa81c2846 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:01.523391 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded33a2-1adf-4ae6-baaf-57a445973ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:01.524320 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded33a2-1adf-4ae6-baaf-57a445973ded None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:01.524698 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded33a2-1adf-4ae6-baaf-57a445973ded None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:01.525073 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded33a2-1adf-4ae6-baaf-57a445973ded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:01.547755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:01.613891 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded33a2-1adf-4ae6-baaf-57a445973ded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:01.615851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded33a2-1adf-4ae6-baaf-57a445973ded None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:01.629778 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da334f-41a1-4e28-82df-56faa81c2846 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:01.672032 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38db22-37a0-4d6b-9c1c-74bcada226c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:01.673091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38db22-37a0-4d6b-9c1c-74bcada226c6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:01.673453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38db22-37a0-4d6b-9c1c-74bcada226c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:01.673909 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38db22-37a0-4d6b-9c1c-74bcada226c6 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:01.675169 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38db22-37a0-4d6b-9c1c-74bcada226c6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:01.675841 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38db22-37a0-4d6b-9c1c-74bcada226c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:01.678254 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38db22-37a0-4d6b-9c1c-74bcada226c6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:01.685308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 520/1061] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:33:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:01.686378 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38db22-37a0-4d6b-9c1c-74bcada226c6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:01.742355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 542/1062] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:33:01 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:33:01.743242 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded33a2-1adf-4ae6-baaf-57a445973ded None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:01.747834 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:01.794457 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:01.822343 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38db22-37a0-4d6b-9c1c-74bcada226c6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:01.857464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded33a2-1adf-4ae6-baaf-57a445973ded None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:01.863190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71303212-c74a-4e3a-b743-6be5118a8548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:01.864029 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71303212-c74a-4e3a-b743-6be5118a8548 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:01.864319 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71303212-c74a-4e3a-b743-6be5118a8548 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:01.864597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71303212-c74a-4e3a-b743-6be5118a8548 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:01.878610 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71303212-c74a-4e3a-b743-6be5118a8548 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:01.881546 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71303212-c74a-4e3a-b743-6be5118a8548 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:01.897783 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a97db-43b5-48e1-b44d-2a09b27b6665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:01.898457 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a97db-43b5-48e1-b44d-2a09b27b6665 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:01.898775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a97db-43b5-48e1-b44d-2a09b27b6665 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:01.899056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a97db-43b5-48e1-b44d-2a09b27b6665 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:01.899809 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a97db-43b5-48e1-b44d-2a09b27b6665 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:01.901289 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a97db-43b5-48e1-b44d-2a09b27b6665 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-71303212-c74a-4e3a-b743-6be5118a8548 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:33:01.908050 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:01.909107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:01.910082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:01.910082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:01.910082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:33:01.910082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:33:01.910082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:33:01.910082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:33:01.910082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:33:01.910082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:33:01.910082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:33:01.910082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:01.910718 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 521/1063] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Jun 15 09:33:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:01.911927 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71303212-c74a-4e3a-b743-6be5118a8548 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:01.925966 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 543/1064] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Jun 15 09:33:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:33:01.926863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a97db-43b5-48e1-b44d-2a09b27b6665 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:02.076575 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:02.089580 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a97db-43b5-48e1-b44d-2a09b27b6665 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:02.103563 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71303212-c74a-4e3a-b743-6be5118a8548 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:02.121463 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:02.164564 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4561b6-1aa6-4d2a-a541-eb9aa50927fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:02.165370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cd3c1-e3be-4acc-8c65-5ccb4e3aa8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:02.165692 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4561b6-1aa6-4d2a-a541-eb9aa50927fc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:02.165990 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cd3c1-e3be-4acc-8c65-5ccb4e3aa8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:02.166171 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4561b6-1aa6-4d2a-a541-eb9aa50927fc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:02.166428 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cd3c1-e3be-4acc-8c65-5ccb4e3aa8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:02.166618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4561b6-1aa6-4d2a-a541-eb9aa50927fc None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:02.167005 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cd3c1-e3be-4acc-8c65-5ccb4e3aa8c4 None admin] PATH_INFO: `/v3/projects/ea62c1450a57448cb76286b393aa1d87` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:02.167912 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4561b6-1aa6-4d2a-a541-eb9aa50927fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:02.168388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4561b6-1aa6-4d2a-a541-eb9aa50927fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:02.170996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4561b6-1aa6-4d2a-a541-eb9aa50927fc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:02.171226 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cd3c1-e3be-4acc-8c65-5ccb4e3aa8c4 None admin] RBAC: Authorizing `identity:get_project(project_id=ea62c1450a57448cb76286b393aa1d87)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:02.173952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cd3c1-e3be-4acc-8c65-5ccb4e3aa8c4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:02.177869 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 522/1065] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:33:01 2022] GET /identity/v3/projects/ea62c1450a57448cb76286b393aa1d87 => generated 311 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:02.189667 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cd3c1-e3be-4acc-8c65-5ccb4e3aa8c4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:02.200599 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 544/1066] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Jun 15 09:33:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:02.209287 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4561b6-1aa6-4d2a-a541-eb9aa50927fc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:02.333723 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cd3c1-e3be-4acc-8c65-5ccb4e3aa8c4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:02.359561 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4561b6-1aa6-4d2a-a541-eb9aa50927fc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:02.370240 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b213e3-152f-47be-925d-a1e94058b22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:02.370948 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b213e3-152f-47be-925d-a1e94058b22b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:02.371244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b213e3-152f-47be-925d-a1e94058b22b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:02.371521 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b213e3-152f-47be-925d-a1e94058b22b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:02.372374 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b213e3-152f-47be-925d-a1e94058b22b None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=ea62c1450a57448cb76286b393aa1d87, user.id=cc713721724545afa118f37a596a98b7) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:02.372693 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b213e3-152f-47be-925d-a1e94058b22b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:02.374158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b213e3-152f-47be-925d-a1e94058b22b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:02.382362 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 523/1067] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:33:02 2022] GET /identity/v3/role_assignments?user.id=cc713721724545afa118f37a596a98b7&scope.project.id=ea62c1450a57448cb76286b393aa1d87&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:33:02.413857 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341da0c-da92-49c9-9fec-a5d44a7007cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:02.414945 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341da0c-da92-49c9-9fec-a5d44a7007cc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:02.415417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341da0c-da92-49c9-9fec-a5d44a7007cc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:02.415826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341da0c-da92-49c9-9fec-a5d44a7007cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:02.429140 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341da0c-da92-49c9-9fec-a5d44a7007cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:02.430940 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341da0c-da92-49c9-9fec-a5d44a7007cc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:02.452447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-b341da0c-da92-49c9-9fec-a5d44a7007cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:33:02.452447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:02.452447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:02.452447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:02.452447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:02.452447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:02.452447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:02.452447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:02.452447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:02.452447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:02.452447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:02.452447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:02.452447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:33:02.452447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:33:02.452447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:02.455205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:02.456344 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:33:02.456344 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:33:02.456344 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:33:02.456344 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:33:02.456344 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 545/1068] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:33:02.464947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b213e3-152f-47be-925d-a1e94058b22b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:02.535491 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:02.609194 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b213e3-152f-47be-925d-a1e94058b22b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:02.646201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caccb27-3534-4703-bb9c-ee99b473c1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:02.646922 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caccb27-3534-4703-bb9c-ee99b473c1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:02.647213 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caccb27-3534-4703-bb9c-ee99b473c1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:02.647500 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caccb27-3534-4703-bb9c-ee99b473c1e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:02.648243 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caccb27-3534-4703-bb9c-ee99b473c1e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:02.648556 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caccb27-3534-4703-bb9c-ee99b473c1e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:02.649936 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caccb27-3534-4703-bb9c-ee99b473c1e8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:02.663978 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 524/1069] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:02.670308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341da0c-da92-49c9-9fec-a5d44a7007cc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:02.689827 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:02.833248 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341da0c-da92-49c9-9fec-a5d44a7007cc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:02.880386 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f5e8a-ed7c-43eb-96fa-058e23e29fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:02.881122 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f5e8a-ed7c-43eb-96fa-058e23e29fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:02.881407 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f5e8a-ed7c-43eb-96fa-058e23e29fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:02.881680 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f5e8a-ed7c-43eb-96fa-058e23e29fe9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:02.891393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f5e8a-ed7c-43eb-96fa-058e23e29fe9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:02.892894 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f5e8a-ed7c-43eb-96fa-058e23e29fe9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:02.908888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-3d5f5e8a-ed7c-43eb-96fa-058e23e29fe9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:33:02.908888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:02.908888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:02.908888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:02.908888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:02.908888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:02.908888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:02.908888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:02.908888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:02.908888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:02.908888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:02.908888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:02.908888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:33:02.908888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:33:02.908888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:02.910977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:02.912918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:33:02.912918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:33:02.912918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:33:02.912918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:33:02.912918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:33:02.912918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:33:02.912918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:33:02.912918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:33:02.914367 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 546/1070] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:33:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:33:02.916301 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caccb27-3534-4703-bb9c-ee99b473c1e8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:03.035603 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caccb27-3534-4703-bb9c-ee99b473c1e8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:03.037337 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:03.077262 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba08996-d88f-45e1-9f45-5a7d3f42dac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:03.078527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba08996-d88f-45e1-9f45-5a7d3f42dac1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:03.078810 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba08996-d88f-45e1-9f45-5a7d3f42dac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:03.079086 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba08996-d88f-45e1-9f45-5a7d3f42dac1 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:03.079905 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba08996-d88f-45e1-9f45-5a7d3f42dac1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:03.080220 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba08996-d88f-45e1-9f45-5a7d3f42dac1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:03.081680 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba08996-d88f-45e1-9f45-5a7d3f42dac1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:03.095330 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 525/1071] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:33:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:33:03.101811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f5e8a-ed7c-43eb-96fa-058e23e29fe9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:03.222195 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:03.294114 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f5e8a-ed7c-43eb-96fa-058e23e29fe9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:03.360067 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da438b3a-4b18-4365-a9c0-7ce38fc7749a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:03.361811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da438b3a-4b18-4365-a9c0-7ce38fc7749a None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:03.362418 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da438b3a-4b18-4365-a9c0-7ce38fc7749a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:03.363040 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da438b3a-4b18-4365-a9c0-7ce38fc7749a None admin] PATH_INFO: `/v3/projects/b978d75b349941f5bedbe56544f41ada/users/26dbaf7292444c8f9a6d45bfaf96763f/roles/f81068136c064fa4a26cdb5606d27c4e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:03.367017 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da438b3a-4b18-4365-a9c0-7ce38fc7749a None admin] RBAC: Authorizing `identity:create_grant(project_id=b978d75b349941f5bedbe56544f41ada, user_id=26dbaf7292444c8f9a6d45bfaf96763f, role_id=f81068136c064fa4a26cdb5606d27c4e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:03.369772 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da438b3a-4b18-4365-a9c0-7ce38fc7749a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:03.393286 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 547/1072] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:33:03 2022] PUT /identity/v3/projects/b978d75b349941f5bedbe56544f41ada/users/26dbaf7292444c8f9a6d45bfaf96763f/roles/f81068136c064fa4a26cdb5606d27c4e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 09:33:04.887374 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8da12c-325c-4d4e-8f8d-68177999b4e8 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:04.887888 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8da12c-325c-4d4e-8f8d-68177999b4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:04.888276 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8da12c-325c-4d4e-8f8d-68177999b4e8 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:04.891674 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 526/1073] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:33:04.897808 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958ef12-daeb-4f8d-8987-bdf306ba54cb None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:04.898799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958ef12-daeb-4f8d-8987-bdf306ba54cb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:04.898799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958ef12-daeb-4f8d-8987-bdf306ba54cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:04.917629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db5369-37d2-4414-bf24-49eab0c90082 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:04.918091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db5369-37d2-4414-bf24-49eab0c90082 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:04.918474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db5369-37d2-4414-bf24-49eab0c90082 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:04.918679 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e958ef12-daeb-4f8d-8987-bdf306ba54cb None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:04.920162 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e958ef12-daeb-4f8d-8987-bdf306ba54cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:04.921429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 527/1074] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:04.927507 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f77d5-0068-4b33-b187-92a54df03590 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:04.927507 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f77d5-0068-4b33-b187-92a54df03590 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:04.927507 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f77d5-0068-4b33-b187-92a54df03590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:04.955574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a68f77d5-0068-4b33-b187-92a54df03590 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:04.957647 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a68f77d5-0068-4b33-b187-92a54df03590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:05.040233 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 548/1075] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:33:05.067732 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958ef12-daeb-4f8d-8987-bdf306ba54cb None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:05.076074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 528/1076] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:33:05.099940 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f77d5-0068-4b33-b187-92a54df03590 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:05.164143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:05.239300 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958ef12-daeb-4f8d-8987-bdf306ba54cb None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:05.247240 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:05.264420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f77d5-0068-4b33-b187-92a54df03590 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:05.301925 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b464dcb-3707-4cb7-b775-0981231111ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:05.303418 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b464dcb-3707-4cb7-b775-0981231111ac None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:05.303928 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b464dcb-3707-4cb7-b775-0981231111ac None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:05.304439 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b464dcb-3707-4cb7-b775-0981231111ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:05.321071 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d102-6d42-4972-a83f-ad72a32593ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:05.322599 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d102-6d42-4972-a83f-ad72a32593ed None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:05.322812 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b464dcb-3707-4cb7-b775-0981231111ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:33:05.323510 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d102-6d42-4972-a83f-ad72a32593ed None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:05.324251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d102-6d42-4972-a83f-ad72a32593ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2b464dcb-3707-4cb7-b775-0981231111ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:33:05.331310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:05.333207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:05.335047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:05.335047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:05.335047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:05.335047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:05.335047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:33:05.335047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:33:05.335047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:33:05.335047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:33:05.335047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:33:05.335047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:33:05.335047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:05.335047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:33:05.338157 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 549/1077] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:33:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:05.339807 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b464dcb-3707-4cb7-b775-0981231111ac None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:05.437218 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732d102-6d42-4972-a83f-ad72a32593ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:05.439139 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732d102-6d42-4972-a83f-ad72a32593ed None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:05.518567 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b464dcb-3707-4cb7-b775-0981231111ac None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:05.554482 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:05.579821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:05.584203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea4448-c7a8-4aac-a5a9-ab47192d15ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:05.585168 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea4448-c7a8-4aac-a5a9-ab47192d15ea None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:05.585697 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea4448-c7a8-4aac-a5a9-ab47192d15ea None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:05.586144 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea4448-c7a8-4aac-a5a9-ab47192d15ea None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:05.587667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea4448-c7a8-4aac-a5a9-ab47192d15ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:05.588549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea4448-c7a8-4aac-a5a9-ab47192d15ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:05.590853 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea4448-c7a8-4aac-a5a9-ab47192d15ea None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:05.593199 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 529/1078] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:33:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:33:05.602193 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d102-6d42-4972-a83f-ad72a32593ed None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:05.603594 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 550/1079] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:33:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:05.611141 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea4448-c7a8-4aac-a5a9-ab47192d15ea None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:05.728502 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d102-6d42-4972-a83f-ad72a32593ed None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:05.773573 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea4448-c7a8-4aac-a5a9-ab47192d15ea None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:05.781659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860778d0-2685-4252-950b-d95ec743e7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:05.783087 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860778d0-2685-4252-950b-d95ec743e7ee None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:05.783600 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860778d0-2685-4252-950b-d95ec743e7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:05.784105 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860778d0-2685-4252-950b-d95ec743e7ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:05.805016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860778d0-2685-4252-950b-d95ec743e7ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:05.807993 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860778d0-2685-4252-950b-d95ec743e7ee None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:05.813506 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae799d8-e38a-4857-82f0-8bfbe8f9d12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:05.814421 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae799d8-e38a-4857-82f0-8bfbe8f9d12b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:05.814833 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae799d8-e38a-4857-82f0-8bfbe8f9d12b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:05.815120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae799d8-e38a-4857-82f0-8bfbe8f9d12b None admin] PATH_INFO: `/v3/users/cc713721724545afa118f37a596a98b7` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:05.816498 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae799d8-e38a-4857-82f0-8bfbe8f9d12b None admin] RBAC: Authorizing `identity:get_user(user_id=cc713721724545afa118f37a596a98b7)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:05.818013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae799d8-e38a-4857-82f0-8bfbe8f9d12b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:05.819891 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 551/1080] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:33:05 2022] GET /identity/v3/users/cc713721724545afa118f37a596a98b7 => generated 285 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:05.821279 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c729ec9-e35d-435a-8026-00f13d38718f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:05.821589 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c729ec9-e35d-435a-8026-00f13d38718f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:05.821851 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c729ec9-e35d-435a-8026-00f13d38718f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:05.823308 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 552/1081] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:05.829693 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e24448-22a0-423b-a657-7b3626424cbd None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:05.830064 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e24448-22a0-423b-a657-7b3626424cbd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:05.830534 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e24448-22a0-423b-a657-7b3626424cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:05.849070 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-73e24448-22a0-423b-a657-7b3626424cbd None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:05.849322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-860778d0-2685-4252-950b-d95ec743e7ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:33:05.849322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:05.849322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:05.849322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:05.849322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:05.849322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:05.849322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:05.849322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:05.849322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:05.849322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:05.849322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:05.849322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:05.849322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:33:05.849322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:33:05.849322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:05.850622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:05.851791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:33:05.851791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:33:05.851791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:33:05.851791 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:05.852247 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-73e24448-22a0-423b-a657-7b3626424cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:05.852395 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 530/1082] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:33:05.853539 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860778d0-2685-4252-950b-d95ec743e7ee None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:05.915573 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:05.918810 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:05.945471 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 553/1083] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:33:05.946568 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e24448-22a0-423b-a657-7b3626424cbd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:06.001758 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860778d0-2685-4252-950b-d95ec743e7ee None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:06.038397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5662601-a93b-47c5-add1-8a4744688637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:06.039406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5662601-a93b-47c5-add1-8a4744688637 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:06.039697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5662601-a93b-47c5-add1-8a4744688637 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:06.039973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5662601-a93b-47c5-add1-8a4744688637 None admin] PATH_INFO: `/v3/projects/ea62c1450a57448cb76286b393aa1d87` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:06.041202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5662601-a93b-47c5-add1-8a4744688637 None admin] RBAC: Authorizing `identity:get_project(project_id=ea62c1450a57448cb76286b393aa1d87)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:06.042683 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5662601-a93b-47c5-add1-8a4744688637 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:06.044424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 531/1084] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:33:05 2022] GET /identity/v3/projects/ea62c1450a57448cb76286b393aa1d87 => generated 311 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:06.045292 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5662601-a93b-47c5-add1-8a4744688637 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:06.106052 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e24448-22a0-423b-a657-7b3626424cbd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:06.160057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5662601-a93b-47c5-add1-8a4744688637 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:06.170898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd043f2-4017-489b-bc6a-fe88aa971b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:06.172071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd043f2-4017-489b-bc6a-fe88aa971b40 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:06.172588 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd043f2-4017-489b-bc6a-fe88aa971b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:06.173090 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd043f2-4017-489b-bc6a-fe88aa971b40 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:06.174478 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd043f2-4017-489b-bc6a-fe88aa971b40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:06.175071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd043f2-4017-489b-bc6a-fe88aa971b40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:06.175336 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:06.177850 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd043f2-4017-489b-bc6a-fe88aa971b40 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:06.198701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17c687-00d0-45f3-adbb-caf271a9956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:06.199523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17c687-00d0-45f3-adbb-caf271a9956b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:06.199805 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17c687-00d0-45f3-adbb-caf271a9956b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:06.200082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17c687-00d0-45f3-adbb-caf271a9956b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:06.200228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 554/1085] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:06.201518 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd043f2-4017-489b-bc6a-fe88aa971b40 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:06.226207 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17c687-00d0-45f3-adbb-caf271a9956b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7b17c687-00d0-45f3-adbb-caf271a9956b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:33:06.237445 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:06.238480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:06.240822 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:06.240822 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:06.240822 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:06.240822 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:06.240822 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:33:06.240822 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:33:06.240822 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:33:06.240822 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:33:06.240822 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:33:06.240822 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:33:06.240822 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 09:33:06.240822 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:06.242051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 532/1086] 10.222.0.45 () {56 vars in 1120 bytes} [Wed Jun 15 09:33:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:06.248693 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17c687-00d0-45f3-adbb-caf271a9956b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:06.287186 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:06.393560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd043f2-4017-489b-bc6a-fe88aa971b40 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:06.426107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17c687-00d0-45f3-adbb-caf271a9956b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:06.457087 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df7db2-00f4-491f-aa74-b16a42fed783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:06.458323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df7db2-00f4-491f-aa74-b16a42fed783 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:06.458811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df7db2-00f4-491f-aa74-b16a42fed783 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:06.459195 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df7db2-00f4-491f-aa74-b16a42fed783 None admin] PATH_INFO: `/v3/projects/ea62c1450a57448cb76286b393aa1d87/users/cc713721724545afa118f37a596a98b7/roles/efaf387c51e14931820f2a9b33ac5175` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:06.461589 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df7db2-00f4-491f-aa74-b16a42fed783 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea62c1450a57448cb76286b393aa1d87, user_id=cc713721724545afa118f37a596a98b7, role_id=efaf387c51e14931820f2a9b33ac5175)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:06.464059 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df7db2-00f4-491f-aa74-b16a42fed783 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:06.485428 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b4507-26cb-4f97-b739-89a2a6888a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:06.486249 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b4507-26cb-4f97-b739-89a2a6888a24 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:06.486687 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b4507-26cb-4f97-b739-89a2a6888a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:06.487145 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b4507-26cb-4f97-b739-89a2a6888a24 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:06.488158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b4507-26cb-4f97-b739-89a2a6888a24 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:06.488687 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b4507-26cb-4f97-b739-89a2a6888a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:06.489259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 555/1087] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:33:06 2022] PUT /identity/v3/projects/ea62c1450a57448cb76286b393aa1d87/users/cc713721724545afa118f37a596a98b7/roles/efaf387c51e14931820f2a9b33ac5175 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:33:06.490987 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b4507-26cb-4f97-b739-89a2a6888a24 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:06.505260 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 533/1088] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Jun 15 09:33:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:33:06.512992 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df7db2-00f4-491f-aa74-b16a42fed783 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:06.705334 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:06.712186 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df7db2-00f4-491f-aa74-b16a42fed783 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:06.755212 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85a9c7-7058-4c94-aaed-8443f492b313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:06.756164 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85a9c7-7058-4c94-aaed-8443f492b313 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:06.756549 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85a9c7-7058-4c94-aaed-8443f492b313 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:06.756920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85a9c7-7058-4c94-aaed-8443f492b313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:06.771763 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85a9c7-7058-4c94-aaed-8443f492b313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:06.773424 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85a9c7-7058-4c94-aaed-8443f492b313 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:06.794830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-da85a9c7-7058-4c94-aaed-8443f492b313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:33:06.794830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:06.794830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:06.794830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:06.794830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:06.794830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:06.794830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:06.794830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:06.794830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:06.794830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:06.794830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:06.794830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:06.794830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:33:06.794830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:33:06.794830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:06.796755 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:06.798490 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:33:06.798490 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:33:06.798490 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:33:06.798490 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:33:06.799041 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 556/1089] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:06.804502 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b4507-26cb-4f97-b739-89a2a6888a24 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:06.848818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:06.961414 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b4507-26cb-4f97-b739-89a2a6888a24 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:07.018863 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a325d-ae6c-4a96-a327-49ff5a7ebe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:07.019676 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a325d-ae6c-4a96-a327-49ff5a7ebe17 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:07.020045 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a325d-ae6c-4a96-a327-49ff5a7ebe17 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:07.020446 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a325d-ae6c-4a96-a327-49ff5a7ebe17 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:07.021346 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a325d-ae6c-4a96-a327-49ff5a7ebe17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:07.021739 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a325d-ae6c-4a96-a327-49ff5a7ebe17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:07.023256 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a325d-ae6c-4a96-a327-49ff5a7ebe17 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:07.044212 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 534/1090] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:33:07.046893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85a9c7-7058-4c94-aaed-8443f492b313 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:07.173131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85a9c7-7058-4c94-aaed-8443f492b313 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:07.211875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc010f-4fea-4490-a614-c52220a7a5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:07.212685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc010f-4fea-4490-a614-c52220a7a5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:07.212968 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc010f-4fea-4490-a614-c52220a7a5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:07.213240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc010f-4fea-4490-a614-c52220a7a5a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:07.222831 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc010f-4fea-4490-a614-c52220a7a5a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:07.224284 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc010f-4fea-4490-a614-c52220a7a5a1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7bfc010f-4fea-4490-a614-c52220a7a5a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:33:07.240327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:07.249888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:07.252257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:07.252257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:07.252257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:33:07.252257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:33:07.252257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:33:07.252257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:33:07.252257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:33:07.252257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:33:07.252257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 09:33:07.252257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:33:07.252257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 557/1091] 10.222.0.45 () {56 vars in 1093 bytes} [Wed Jun 15 09:33:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:33:07.255111 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a325d-ae6c-4a96-a327-49ff5a7ebe17 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:07.368961 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:07.380708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a325d-ae6c-4a96-a327-49ff5a7ebe17 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:07.431483 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc6b5b-5b5e-42c6-8f18-79a1d2538936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:07.432045 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc6b5b-5b5e-42c6-8f18-79a1d2538936 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:07.432329 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc6b5b-5b5e-42c6-8f18-79a1d2538936 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:07.432607 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc6b5b-5b5e-42c6-8f18-79a1d2538936 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:07.433453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc6b5b-5b5e-42c6-8f18-79a1d2538936 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:07.433765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc6b5b-5b5e-42c6-8f18-79a1d2538936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:07.435239 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc6b5b-5b5e-42c6-8f18-79a1d2538936 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:07.455030 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 535/1092] 10.222.0.45 () {56 vars in 1133 bytes} [Wed Jun 15 09:33:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:07.461102 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc010f-4fea-4490-a614-c52220a7a5a1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:07.476412 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:07.627344 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc010f-4fea-4490-a614-c52220a7a5a1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:07.690700 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeacddd-2b7c-48aa-8676-715c3b63e55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:07.691780 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeacddd-2b7c-48aa-8676-715c3b63e55f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:07.692287 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeacddd-2b7c-48aa-8676-715c3b63e55f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:07.692776 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeacddd-2b7c-48aa-8676-715c3b63e55f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:07.815559 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeacddd-2b7c-48aa-8676-715c3b63e55f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:07.817925 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeacddd-2b7c-48aa-8676-715c3b63e55f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:07.837933 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:08.008343 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 558/1093] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:33:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 09:33:08.011345 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc6b5b-5b5e-42c6-8f18-79a1d2538936 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:08.193410 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc6b5b-5b5e-42c6-8f18-79a1d2538936 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:08.258735 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1602f2-6d27-4873-b852-3dac4c28fb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:08.259837 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1602f2-6d27-4873-b852-3dac4c28fb4d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:08.260342 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1602f2-6d27-4873-b852-3dac4c28fb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:08.260863 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1602f2-6d27-4873-b852-3dac4c28fb4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:08.280718 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1602f2-6d27-4873-b852-3dac4c28fb4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:08.283480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1602f2-6d27-4873-b852-3dac4c28fb4d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:08.315820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-be1602f2-6d27-4873-b852-3dac4c28fb4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:33:08.315820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:08.315820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:08.315820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:08.315820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:08.315820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:08.315820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:08.315820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:08.315820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:08.315820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:08.315820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:08.315820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:08.315820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:33:08.315820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:33:08.315820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:08.316818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:08.317709 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:33:08.317709 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:33:08.317709 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:33:08.317709 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:08.318181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 536/1094] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:08.324574 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeacddd-2b7c-48aa-8676-715c3b63e55f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:08.444228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeacddd-2b7c-48aa-8676-715c3b63e55f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:08.457442 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:08.486480 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b44678-872f-48a6-a1ec-9e3c37e8bee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:08.487195 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b44678-872f-48a6-a1ec-9e3c37e8bee8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:08.487476 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b44678-872f-48a6-a1ec-9e3c37e8bee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:08.487754 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b44678-872f-48a6-a1ec-9e3c37e8bee8 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:08.488504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b44678-872f-48a6-a1ec-9e3c37e8bee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:08.488810 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b44678-872f-48a6-a1ec-9e3c37e8bee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:08.490249 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b44678-872f-48a6-a1ec-9e3c37e8bee8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:08.505314 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 559/1095] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:33:08.511975 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1602f2-6d27-4873-b852-3dac4c28fb4d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:08.517197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:08.637818 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1602f2-6d27-4873-b852-3dac4c28fb4d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:08.677040 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40efb22-f1b1-4e1f-8e75-ce9835f1da1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:08.677844 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40efb22-f1b1-4e1f-8e75-ce9835f1da1b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:08.678165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40efb22-f1b1-4e1f-8e75-ce9835f1da1b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:08.678436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40efb22-f1b1-4e1f-8e75-ce9835f1da1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:08.685794 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40efb22-f1b1-4e1f-8e75-ce9835f1da1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:08.687838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40efb22-f1b1-4e1f-8e75-ce9835f1da1b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:08.702122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-d40efb22-f1b1-4e1f-8e75-ce9835f1da1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:33:08.702122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:08.702122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:08.702122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:08.702122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:08.702122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:08.702122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:08.702122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:08.702122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:08.702122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:08.702122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:08.702122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:08.702122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:33:08.702122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:33:08.702122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:08.703237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:08.704606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:33:08.704606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:33:08.704606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:33:08.704606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:33:08.704606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:33:08.704606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:33:08.704606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:33:08.704606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:08.704606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 537/1096] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:33:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:08.709401 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b44678-872f-48a6-a1ec-9e3c37e8bee8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:08.791894 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010ba93-8fa9-4928-8526-59ba34014cc4 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:08.792116 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010ba93-8fa9-4928-8526-59ba34014cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:08.792368 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010ba93-8fa9-4928-8526-59ba34014cc4 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:08.793793 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 538/1097] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:08.799749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5325f5e-ba9d-483f-9004-8ef11bc21592 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:08.800037 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5325f5e-ba9d-483f-9004-8ef11bc21592 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:08.800319 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5325f5e-ba9d-483f-9004-8ef11bc21592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:08.817577 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a5325f5e-ba9d-483f-9004-8ef11bc21592 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:08.818919 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a5325f5e-ba9d-483f-9004-8ef11bc21592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:08.820120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b44678-872f-48a6-a1ec-9e3c37e8bee8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:08.862752 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bef94-079f-49c2-9547-d66c4ef1c9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:08.863811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bef94-079f-49c2-9547-d66c4ef1c9df None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:08.864295 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bef94-079f-49c2-9547-d66c4ef1c9df None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:08.864781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bef94-079f-49c2-9547-d66c4ef1c9df None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:08.866236 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bef94-079f-49c2-9547-d66c4ef1c9df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:08.866802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bef94-079f-49c2-9547-d66c4ef1c9df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:08.869448 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bef94-079f-49c2-9547-d66c4ef1c9df None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:08.881932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:08.890828 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 560/1098] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:33:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:08.893875 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 539/1099] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:33:08.896856 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bef94-079f-49c2-9547-d66c4ef1c9df None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:08.918205 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5325f5e-ba9d-483f-9004-8ef11bc21592 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:08.930176 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:09.003434 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bef94-079f-49c2-9547-d66c4ef1c9df None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:09.024144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5325f5e-ba9d-483f-9004-8ef11bc21592 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:09.041032 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5108c60-5c5d-4487-bb19-bbb8686ceb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:09.041697 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5108c60-5c5d-4487-bb19-bbb8686ceb66 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:09.042032 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5108c60-5c5d-4487-bb19-bbb8686ceb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:09.042262 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5108c60-5c5d-4487-bb19-bbb8686ceb66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:09.043135 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5108c60-5c5d-4487-bb19-bbb8686ceb66 None admin] RBAC: Adding query filter params (role.id=f81068136c064fa4a26cdb5606d27c4e, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=26dbaf7292444c8f9a6d45bfaf96763f) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:09.043451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5108c60-5c5d-4487-bb19-bbb8686ceb66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:09.044885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5108c60-5c5d-4487-bb19-bbb8686ceb66 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:09.052043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 561/1100] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:33:08 2022] GET /identity/v3/role_assignments?user.id=26dbaf7292444c8f9a6d45bfaf96763f&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=f81068136c064fa4a26cdb5606d27c4e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:09.060721 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecce30-a5d6-4c3e-a1b4-2188076ececf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:09.061584 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecce30-a5d6-4c3e-a1b4-2188076ececf None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:09.061868 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecce30-a5d6-4c3e-a1b4-2188076ececf None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:09.062148 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecce30-a5d6-4c3e-a1b4-2188076ececf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:09.076208 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecce30-a5d6-4c3e-a1b4-2188076ececf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-75ecce30-a5d6-4c3e-a1b4-2188076ececf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:33:09.085006 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:09.087074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:09.088678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:09.088678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:09.088678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:09.088678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:09.088678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:33:09.088678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:33:09.088678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:33:09.088678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:33:09.088678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:33:09.088678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:33:09.088678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:09.088678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:09.088678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 540/1101] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:33:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:09.097435 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5108c60-5c5d-4487-bb19-bbb8686ceb66 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:09.214688 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:09.227984 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5108c60-5c5d-4487-bb19-bbb8686ceb66 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:09.270833 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5d27e-7356-4aaf-bd1a-1ba7d374fa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:09.271523 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5d27e-7356-4aaf-bd1a-1ba7d374fa91 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:09.271801 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5d27e-7356-4aaf-bd1a-1ba7d374fa91 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:09.272087 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5d27e-7356-4aaf-bd1a-1ba7d374fa91 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:09.272858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5d27e-7356-4aaf-bd1a-1ba7d374fa91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:09.273167 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5d27e-7356-4aaf-bd1a-1ba7d374fa91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:09.274585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5d27e-7356-4aaf-bd1a-1ba7d374fa91 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:09.284301 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 562/1102] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:33:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:09.290315 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecce30-a5d6-4c3e-a1b4-2188076ececf None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:09.361522 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:09.415703 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecce30-a5d6-4c3e-a1b4-2188076ececf None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:09.452329 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29e1fe-cfac-4eb6-a829-c774c3d5b2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:09.453208 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29e1fe-cfac-4eb6-a829-c774c3d5b2ef None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:09.453492 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29e1fe-cfac-4eb6-a829-c774c3d5b2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:09.453768 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29e1fe-cfac-4eb6-a829-c774c3d5b2ef None admin] PATH_INFO: `/v3/users/cc713721724545afa118f37a596a98b7` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:09.455045 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29e1fe-cfac-4eb6-a829-c774c3d5b2ef None admin] RBAC: Authorizing `identity:get_user(user_id=cc713721724545afa118f37a596a98b7)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:09.456477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29e1fe-cfac-4eb6-a829-c774c3d5b2ef None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:09.458122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 541/1103] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:33:09 2022] GET /identity/v3/users/cc713721724545afa118f37a596a98b7 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:33:09.464181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5d27e-7356-4aaf-bd1a-1ba7d374fa91 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:09.599976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5d27e-7356-4aaf-bd1a-1ba7d374fa91 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:09.641963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c2c3d-53fb-4287-bb0d-31182e495bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:09.642770 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c2c3d-53fb-4287-bb0d-31182e495bae None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:09.643226 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c2c3d-53fb-4287-bb0d-31182e495bae None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:09.643697 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c2c3d-53fb-4287-bb0d-31182e495bae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:09.682196 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:09.744946 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c2c3d-53fb-4287-bb0d-31182e495bae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:09.746654 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c2c3d-53fb-4287-bb0d-31182e495bae None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:09.871621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 563/1104] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:33:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:33:09.879007 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29e1fe-cfac-4eb6-a829-c774c3d5b2ef None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:10.022548 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29e1fe-cfac-4eb6-a829-c774c3d5b2ef None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:10.053426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:10.068621 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93627143-3df6-4e2e-8905-1a07b3257864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:10.069517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93627143-3df6-4e2e-8905-1a07b3257864 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:10.069801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93627143-3df6-4e2e-8905-1a07b3257864 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:10.070077 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93627143-3df6-4e2e-8905-1a07b3257864 None admin] PATH_INFO: `/v3/projects/ea62c1450a57448cb76286b393aa1d87` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:10.071486 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93627143-3df6-4e2e-8905-1a07b3257864 None admin] RBAC: Authorizing `identity:get_project(project_id=ea62c1450a57448cb76286b393aa1d87)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:10.072972 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93627143-3df6-4e2e-8905-1a07b3257864 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:10.074810 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 542/1105] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:33:09 2022] GET /identity/v3/projects/ea62c1450a57448cb76286b393aa1d87 => generated 311 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:10.081262 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c2c3d-53fb-4287-bb0d-31182e495bae None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:10.148122 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:10.191752 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c2c3d-53fb-4287-bb0d-31182e495bae None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:10.225767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d0cf9-80d8-412f-b32a-2000956cd6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:10.226418 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d0cf9-80d8-412f-b32a-2000956cd6ed None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:10.226796 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d0cf9-80d8-412f-b32a-2000956cd6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:10.227071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d0cf9-80d8-412f-b32a-2000956cd6ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:10.227893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d0cf9-80d8-412f-b32a-2000956cd6ed None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=ea62c1450a57448cb76286b393aa1d87, user.id=cc713721724545afa118f37a596a98b7) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:10.228200 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d0cf9-80d8-412f-b32a-2000956cd6ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:10.229615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d0cf9-80d8-412f-b32a-2000956cd6ed None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:10.236234 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 564/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:33:10 2022] GET /identity/v3/role_assignments?user.id=cc713721724545afa118f37a596a98b7&scope.project.id=ea62c1450a57448cb76286b393aa1d87&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:12.422878 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84874-560a-42da-a0c5-320183295978 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:12.423692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84874-560a-42da-a0c5-320183295978 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:12.423884 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84874-560a-42da-a0c5-320183295978 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:12.425319 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 543/1107] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:12.431537 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0e1fa-b89e-4fba-a720-9a9cb0215205 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:12.432073 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0e1fa-b89e-4fba-a720-9a9cb0215205 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:12.432202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0e1fa-b89e-4fba-a720-9a9cb0215205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:12.450132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dac0e1fa-b89e-4fba-a720-9a9cb0215205 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:12.451952 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dac0e1fa-b89e-4fba-a720-9a9cb0215205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:12.527394 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 565/1108] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:12.563061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84874-560a-42da-a0c5-320183295978 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:12.666659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84874-560a-42da-a0c5-320183295978 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:12.700331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2d68e-13a9-4e8b-9c02-05b5c7748ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:12.701047 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2d68e-13a9-4e8b-9c02-05b5c7748ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:12.701370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2d68e-13a9-4e8b-9c02-05b5c7748ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:12.701650 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2d68e-13a9-4e8b-9c02-05b5c7748ff9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:12.702862 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2d68e-13a9-4e8b-9c02-05b5c7748ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:12.704288 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2d68e-13a9-4e8b-9c02-05b5c7748ff9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:12.705903 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 544/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:33:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:12.711774 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0e1fa-b89e-4fba-a720-9a9cb0215205 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:12.761288 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:12.812683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0e1fa-b89e-4fba-a720-9a9cb0215205 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:12.846326 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf138a1-e097-443e-82f6-ecbe9ea8c843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:12.847053 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf138a1-e097-443e-82f6-ecbe9ea8c843 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:12.847335 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf138a1-e097-443e-82f6-ecbe9ea8c843 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:12.847612 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf138a1-e097-443e-82f6-ecbe9ea8c843 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:12.848313 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf138a1-e097-443e-82f6-ecbe9ea8c843 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:12.849734 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf138a1-e097-443e-82f6-ecbe9ea8c843 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:12.871083 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 566/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:33:12 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:33:15.126410 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a3e30-8d87-469e-a5d9-d362ba1f0d88 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:15.127011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a3e30-8d87-469e-a5d9-d362ba1f0d88 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:15.127128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a3e30-8d87-469e-a5d9-d362ba1f0d88 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:15.128510 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 545/1111] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:15.134712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de04f94-1c8e-4bc0-8738-6d261f765632 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:15.135190 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de04f94-1c8e-4bc0-8738-6d261f765632 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:15.135342 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de04f94-1c8e-4bc0-8738-6d261f765632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:15.152286 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7de04f94-1c8e-4bc0-8738-6d261f765632 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:15.153509 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7de04f94-1c8e-4bc0-8738-6d261f765632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:15.226347 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 567/1112] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:15.251191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a3e30-8d87-469e-a5d9-d362ba1f0d88 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:15.321311 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:15.373523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a3e30-8d87-469e-a5d9-d362ba1f0d88 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:15.411353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca04bc9-f071-48db-935a-50a6e3aa7a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:15.412126 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca04bc9-f071-48db-935a-50a6e3aa7a71 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:15.412414 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca04bc9-f071-48db-935a-50a6e3aa7a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:15.412687 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca04bc9-f071-48db-935a-50a6e3aa7a71 None admin] PATH_INFO: `/v3/roles/f0b3744c39ca4eb7b78ef642c0175a0a` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:15.414192 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca04bc9-f071-48db-935a-50a6e3aa7a71 None admin] RBAC: Authorizing `identity:get_role(role_id=f0b3744c39ca4eb7b78ef642c0175a0a)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:15.415595 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca04bc9-f071-48db-935a-50a6e3aa7a71 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:15.416995 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 546/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:33:15 2022] GET /identity/v3/roles/f0b3744c39ca4eb7b78ef642c0175a0a => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:15.426390 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de04f94-1c8e-4bc0-8738-6d261f765632 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:15.462212 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:15.528831 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de04f94-1c8e-4bc0-8738-6d261f765632 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:15.564608 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fe2bf-faee-41f4-9f7b-72d1039a6875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:15.565487 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fe2bf-faee-41f4-9f7b-72d1039a6875 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:15.565769 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fe2bf-faee-41f4-9f7b-72d1039a6875 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:15.566044 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fe2bf-faee-41f4-9f7b-72d1039a6875 None admin] PATH_INFO: `/v3/users/e77eea42927148c6bf76d7b6ca603815` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:15.581979 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fe2bf-faee-41f4-9f7b-72d1039a6875 None admin] RBAC: Authorizing `identity:get_user(user_id=e77eea42927148c6bf76d7b6ca603815)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:15.583485 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fe2bf-faee-41f4-9f7b-72d1039a6875 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:15.585328 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 568/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:33:15 2022] GET /identity/v3/users/e77eea42927148c6bf76d7b6ca603815 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:15.592178 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca04bc9-f071-48db-935a-50a6e3aa7a71 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:15.700319 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca04bc9-f071-48db-935a-50a6e3aa7a71 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:15.727581 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:15.737535 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fe2dc-21f7-4695-85c2-f6fa9aff8196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:15.738197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fe2dc-21f7-4695-85c2-f6fa9aff8196 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:15.738485 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fe2dc-21f7-4695-85c2-f6fa9aff8196 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:15.738788 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fe2dc-21f7-4695-85c2-f6fa9aff8196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:15.806218 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fe2dc-21f7-4695-85c2-f6fa9aff8196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:15.807696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fe2dc-21f7-4695-85c2-f6fa9aff8196 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:15.909158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 547/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:33:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 09:33:15.915345 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fe2bf-faee-41f4-9f7b-72d1039a6875 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:16.009523 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:16.016841 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fe2bf-faee-41f4-9f7b-72d1039a6875 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:16.051593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f637bd-c847-4970-a9d2-e3f17b8f5a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:16.052468 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f637bd-c847-4970-a9d2-e3f17b8f5a87 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:16.052752 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f637bd-c847-4970-a9d2-e3f17b8f5a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:16.053027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f637bd-c847-4970-a9d2-e3f17b8f5a87 None admin] PATH_INFO: `/v3/projects/ea62c1450a57448cb76286b393aa1d87` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:16.054209 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f637bd-c847-4970-a9d2-e3f17b8f5a87 None admin] RBAC: Authorizing `identity:get_project(project_id=ea62c1450a57448cb76286b393aa1d87)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:16.055662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f637bd-c847-4970-a9d2-e3f17b8f5a87 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:16.057359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 569/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:33:15 2022] GET /identity/v3/projects/ea62c1450a57448cb76286b393aa1d87 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:16.063808 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fe2dc-21f7-4695-85c2-f6fa9aff8196 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:16.090557 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:16.163230 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fe2dc-21f7-4695-85c2-f6fa9aff8196 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:16.201585 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac95e4-abba-4a83-bf43-b19170efd219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:16.202245 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac95e4-abba-4a83-bf43-b19170efd219 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:16.202553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac95e4-abba-4a83-bf43-b19170efd219 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:16.202836 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac95e4-abba-4a83-bf43-b19170efd219 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:16.203666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac95e4-abba-4a83-bf43-b19170efd219 None admin] RBAC: Adding query filter params (role.id=f0b3744c39ca4eb7b78ef642c0175a0a, scope.project.id=ea62c1450a57448cb76286b393aa1d87, user.id=e77eea42927148c6bf76d7b6ca603815) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:16.203982 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac95e4-abba-4a83-bf43-b19170efd219 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:16.205410 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac95e4-abba-4a83-bf43-b19170efd219 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:16.210958 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 548/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:33:16 2022] GET /identity/v3/role_assignments?user.id=e77eea42927148c6bf76d7b6ca603815&scope.project.id=ea62c1450a57448cb76286b393aa1d87&role.id=f0b3744c39ca4eb7b78ef642c0175a0a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:18.347959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daac3df-f623-4f58-8edc-2190c23d26fb None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:18.348522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daac3df-f623-4f58-8edc-2190c23d26fb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:18.348522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daac3df-f623-4f58-8edc-2190c23d26fb None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:18.349904 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 570/1118] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:18.358152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928a24d-73bb-4cb3-92cb-794b1befb806 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:18.358702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928a24d-73bb-4cb3-92cb-794b1befb806 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:18.358800 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928a24d-73bb-4cb3-92cb-794b1befb806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:18.376325 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7928a24d-73bb-4cb3-92cb-794b1befb806 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:18.377555 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7928a24d-73bb-4cb3-92cb-794b1befb806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:18.450016 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 549/1119] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:18.479817 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daac3df-f623-4f58-8edc-2190c23d26fb None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:18.590855 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daac3df-f623-4f58-8edc-2190c23d26fb None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:18.631876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6695cf-4260-4b08-9678-fcf4ffed5189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:18.632695 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6695cf-4260-4b08-9678-fcf4ffed5189 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:18.632990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6695cf-4260-4b08-9678-fcf4ffed5189 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:18.633268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6695cf-4260-4b08-9678-fcf4ffed5189 None admin] PATH_INFO: `/v3/roles/f0b3744c39ca4eb7b78ef642c0175a0a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:18.634997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6695cf-4260-4b08-9678-fcf4ffed5189 None admin] RBAC: Authorizing `identity:get_role(role_id=f0b3744c39ca4eb7b78ef642c0175a0a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:18.636400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6695cf-4260-4b08-9678-fcf4ffed5189 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:18.637867 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 571/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:33:18 2022] GET /identity/v3/roles/f0b3744c39ca4eb7b78ef642c0175a0a => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:18.647387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928a24d-73bb-4cb3-92cb-794b1befb806 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:18.672095 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:18.764080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928a24d-73bb-4cb3-92cb-794b1befb806 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:18.801248 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3028e-7fd6-40a2-bd5a-d3babf5fb322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:18.802123 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3028e-7fd6-40a2-bd5a-d3babf5fb322 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:18.802404 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3028e-7fd6-40a2-bd5a-d3babf5fb322 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:18.802707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3028e-7fd6-40a2-bd5a-d3babf5fb322 None admin] PATH_INFO: `/v3/users/e77eea42927148c6bf76d7b6ca603815` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:18.803937 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3028e-7fd6-40a2-bd5a-d3babf5fb322 None admin] RBAC: Authorizing `identity:get_user(user_id=e77eea42927148c6bf76d7b6ca603815)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:18.805377 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3028e-7fd6-40a2-bd5a-d3babf5fb322 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:18.807069 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 550/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:33:18 2022] GET /identity/v3/users/e77eea42927148c6bf76d7b6ca603815 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:18.816614 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6695cf-4260-4b08-9678-fcf4ffed5189 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:18.864791 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:18.942223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6695cf-4260-4b08-9678-fcf4ffed5189 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:18.980314 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93fc9b-ee89-44db-9338-c4afa9372791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:18.981175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93fc9b-ee89-44db-9338-c4afa9372791 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:18.981461 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93fc9b-ee89-44db-9338-c4afa9372791 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:18.981776 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93fc9b-ee89-44db-9338-c4afa9372791 None admin] PATH_INFO: `/v3/projects/ea62c1450a57448cb76286b393aa1d87` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:18.983035 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93fc9b-ee89-44db-9338-c4afa9372791 None admin] RBAC: Authorizing `identity:get_project(project_id=ea62c1450a57448cb76286b393aa1d87)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:18.984474 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93fc9b-ee89-44db-9338-c4afa9372791 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:18.986209 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 572/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:33:18 2022] GET /identity/v3/projects/ea62c1450a57448cb76286b393aa1d87 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:18.995354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3028e-7fd6-40a2-bd5a-d3babf5fb322 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:19.088115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:19.101386 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3028e-7fd6-40a2-bd5a-d3babf5fb322 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:19.136618 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d936300-cdaa-4b52-ab4d-c2efd1b45acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:19.137519 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d936300-cdaa-4b52-ab4d-c2efd1b45acb None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:19.137804 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d936300-cdaa-4b52-ab4d-c2efd1b45acb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:19.138644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d936300-cdaa-4b52-ab4d-c2efd1b45acb None admin] PATH_INFO: `/v3/projects/ea62c1450a57448cb76286b393aa1d87/users/e77eea42927148c6bf76d7b6ca603815/roles/f0b3744c39ca4eb7b78ef642c0175a0a` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:19.140918 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d936300-cdaa-4b52-ab4d-c2efd1b45acb None admin] RBAC: Authorizing `identity:create_grant(project_id=ea62c1450a57448cb76286b393aa1d87, user_id=e77eea42927148c6bf76d7b6ca603815, role_id=f0b3744c39ca4eb7b78ef642c0175a0a)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:19.142359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d936300-cdaa-4b52-ab4d-c2efd1b45acb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:19.157896 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 551/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:33:18 2022] PUT /identity/v3/projects/ea62c1450a57448cb76286b393aa1d87/users/e77eea42927148c6bf76d7b6ca603815/roles/f0b3744c39ca4eb7b78ef642c0175a0a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:33:21.337835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ca974-bdf6-421a-8b33-b13f8448bcb4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:21.338441 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ca974-bdf6-421a-8b33-b13f8448bcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:21.338441 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ca974-bdf6-421a-8b33-b13f8448bcb4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:21.339767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 573/1124] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:21.345528 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0a84c-c8f9-465a-8b3a-1f92c21582ba None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:21.346081 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0a84c-c8f9-465a-8b3a-1f92c21582ba None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:21.346081 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0a84c-c8f9-465a-8b3a-1f92c21582ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:21.363856 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b3b0a84c-c8f9-465a-8b3a-1f92c21582ba None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:21.365059 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b3b0a84c-c8f9-465a-8b3a-1f92c21582ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:21.443454 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 552/1125] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:21.467416 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ca974-bdf6-421a-8b33-b13f8448bcb4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:21.575963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:21.581929 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ca974-bdf6-421a-8b33-b13f8448bcb4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:21.620772 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4415a-9621-4dec-aeae-ec5ed7c5ec75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:21.621563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4415a-9621-4dec-aeae-ec5ed7c5ec75 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:21.621845 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4415a-9621-4dec-aeae-ec5ed7c5ec75 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:21.622171 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4415a-9621-4dec-aeae-ec5ed7c5ec75 None admin] PATH_INFO: `/v3/roles/f0b3744c39ca4eb7b78ef642c0175a0a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:21.623854 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4415a-9621-4dec-aeae-ec5ed7c5ec75 None admin] RBAC: Authorizing `identity:get_role(role_id=f0b3744c39ca4eb7b78ef642c0175a0a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:21.625258 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4415a-9621-4dec-aeae-ec5ed7c5ec75 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:21.626740 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 574/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:33:21 2022] GET /identity/v3/roles/f0b3744c39ca4eb7b78ef642c0175a0a => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:21.633039 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0a84c-c8f9-465a-8b3a-1f92c21582ba None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:21.720762 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:21.746172 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0a84c-c8f9-465a-8b3a-1f92c21582ba None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:21.782828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2ad7d-a8be-4918-a665-c400ac244ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:21.783717 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2ad7d-a8be-4918-a665-c400ac244ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:21.784002 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2ad7d-a8be-4918-a665-c400ac244ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:21.784277 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2ad7d-a8be-4918-a665-c400ac244ed8 None admin] PATH_INFO: `/v3/users/e77eea42927148c6bf76d7b6ca603815` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:21.785525 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2ad7d-a8be-4918-a665-c400ac244ed8 None admin] RBAC: Authorizing `identity:get_user(user_id=e77eea42927148c6bf76d7b6ca603815)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:21.787013 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2ad7d-a8be-4918-a665-c400ac244ed8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:21.788693 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 553/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:33:21 2022] GET /identity/v3/users/e77eea42927148c6bf76d7b6ca603815 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:21.797438 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4415a-9621-4dec-aeae-ec5ed7c5ec75 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:21.945867 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4415a-9621-4dec-aeae-ec5ed7c5ec75 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:21.981027 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733b003-7c8a-4de3-a226-3848262937bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:21.981743 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733b003-7c8a-4de3-a226-3848262937bb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:21.982029 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733b003-7c8a-4de3-a226-3848262937bb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:21.982310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733b003-7c8a-4de3-a226-3848262937bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:22.017316 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:22.054181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733b003-7c8a-4de3-a226-3848262937bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:22.055675 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733b003-7c8a-4de3-a226-3848262937bb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:22.163881 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 575/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:33:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 09:33:22.170108 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2ad7d-a8be-4918-a665-c400ac244ed8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:22.270833 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2ad7d-a8be-4918-a665-c400ac244ed8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:22.304503 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fa2a2-44c9-4f52-96af-bb61011a2c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:22.305372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fa2a2-44c9-4f52-96af-bb61011a2c8c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:22.305650 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fa2a2-44c9-4f52-96af-bb61011a2c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:22.305926 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fa2a2-44c9-4f52-96af-bb61011a2c8c None admin] PATH_INFO: `/v3/projects/ea62c1450a57448cb76286b393aa1d87` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:22.307151 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fa2a2-44c9-4f52-96af-bb61011a2c8c None admin] RBAC: Authorizing `identity:get_project(project_id=ea62c1450a57448cb76286b393aa1d87)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:22.308591 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fa2a2-44c9-4f52-96af-bb61011a2c8c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:22.310859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 554/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:33:22 2022] GET /identity/v3/projects/ea62c1450a57448cb76286b393aa1d87 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:22.317385 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733b003-7c8a-4de3-a226-3848262937bb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:22.384947 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:22.422002 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733b003-7c8a-4de3-a226-3848262937bb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:22.457827 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac08b2d-5bb8-4255-b13c-810b75425985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:22.458484 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac08b2d-5bb8-4255-b13c-810b75425985 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:22.458800 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac08b2d-5bb8-4255-b13c-810b75425985 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:22.459083 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac08b2d-5bb8-4255-b13c-810b75425985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:22.459914 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac08b2d-5bb8-4255-b13c-810b75425985 None admin] RBAC: Adding query filter params (role.id=f0b3744c39ca4eb7b78ef642c0175a0a, scope.project.id=ea62c1450a57448cb76286b393aa1d87, user.id=e77eea42927148c6bf76d7b6ca603815) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:22.460223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac08b2d-5bb8-4255-b13c-810b75425985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:22.461643 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac08b2d-5bb8-4255-b13c-810b75425985 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:22.467841 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 576/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:33:22 2022] GET /identity/v3/role_assignments?user.id=e77eea42927148c6bf76d7b6ca603815&scope.project.id=ea62c1450a57448cb76286b393aa1d87&role.id=f0b3744c39ca4eb7b78ef642c0175a0a => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:33:24.633847 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675921b4-137c-4731-94b6-c6e9eeef577e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:24.634367 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675921b4-137c-4731-94b6-c6e9eeef577e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:24.634455 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675921b4-137c-4731-94b6-c6e9eeef577e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:24.636057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 555/1131] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:24.641231 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b5901-4f0a-4c29-b710-3dc5535ccdd5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:24.641607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b5901-4f0a-4c29-b710-3dc5535ccdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:24.641787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b5901-4f0a-4c29-b710-3dc5535ccdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:24.658787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-918b5901-4f0a-4c29-b710-3dc5535ccdd5 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:24.659974 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-918b5901-4f0a-4c29-b710-3dc5535ccdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:24.724543 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 577/1132] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:24.749121 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675921b4-137c-4731-94b6-c6e9eeef577e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:24.764916 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:24.851901 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675921b4-137c-4731-94b6-c6e9eeef577e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:24.886074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e974dad-80ea-43dc-9bfd-c44b3023d839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:24.886892 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e974dad-80ea-43dc-9bfd-c44b3023d839 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:24.887180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e974dad-80ea-43dc-9bfd-c44b3023d839 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:24.888156 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e974dad-80ea-43dc-9bfd-c44b3023d839 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:24.889143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e974dad-80ea-43dc-9bfd-c44b3023d839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:24.890596 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e974dad-80ea-43dc-9bfd-c44b3023d839 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:24.892207 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 556/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:33:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:24.898136 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b5901-4f0a-4c29-b710-3dc5535ccdd5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:24.956464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:24.997167 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b5901-4f0a-4c29-b710-3dc5535ccdd5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:25.031509 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00462bb-cfe0-42cf-afec-690495711630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:25.032175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00462bb-cfe0-42cf-afec-690495711630 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:25.032462 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00462bb-cfe0-42cf-afec-690495711630 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:25.032745 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00462bb-cfe0-42cf-afec-690495711630 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:25.033452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00462bb-cfe0-42cf-afec-690495711630 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:25.034920 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00462bb-cfe0-42cf-afec-690495711630 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:25.059551 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 578/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Jun 15 09:33:24 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:33:27.238441 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335ac77-1f57-44a7-80ca-cb015bdfced0 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:27.238999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335ac77-1f57-44a7-80ca-cb015bdfced0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:27.238999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335ac77-1f57-44a7-80ca-cb015bdfced0 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:27.240369 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 557/1135] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:27.245900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fa94c-3e9d-4aeb-a8d1-ca715c27f93a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:27.246342 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fa94c-3e9d-4aeb-a8d1-ca715c27f93a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:27.247080 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fa94c-3e9d-4aeb-a8d1-ca715c27f93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:27.264330 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fd0fa94c-3e9d-4aeb-a8d1-ca715c27f93a None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:27.265551 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fd0fa94c-3e9d-4aeb-a8d1-ca715c27f93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:27.335459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 579/1136] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:27.361022 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335ac77-1f57-44a7-80ca-cb015bdfced0 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:27.447987 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:27.468237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335ac77-1f57-44a7-80ca-cb015bdfced0 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:27.503488 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6098ea-7b8b-41ce-985e-e580e04da825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:27.504285 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6098ea-7b8b-41ce-985e-e580e04da825 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:27.504569 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6098ea-7b8b-41ce-985e-e580e04da825 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:27.504848 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6098ea-7b8b-41ce-985e-e580e04da825 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:27.506294 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6098ea-7b8b-41ce-985e-e580e04da825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:27.507778 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6098ea-7b8b-41ce-985e-e580e04da825 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:27.509464 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 558/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:33:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:27.515389 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fa94c-3e9d-4aeb-a8d1-ca715c27f93a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:27.560249 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:27.619120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fa94c-3e9d-4aeb-a8d1-ca715c27f93a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:27.651986 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3237f2b-c79d-45e9-a570-ef161b9e7e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:27.653160 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3237f2b-c79d-45e9-a570-ef161b9e7e17 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:27.653440 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3237f2b-c79d-45e9-a570-ef161b9e7e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:27.653715 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3237f2b-c79d-45e9-a570-ef161b9e7e17 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:27.654417 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3237f2b-c79d-45e9-a570-ef161b9e7e17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:27.655856 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3237f2b-c79d-45e9-a570-ef161b9e7e17 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:27.676782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 580/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:33:27 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:33:29.873437 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f519a9-4696-4780-abe7-10983bebe036 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:29.873954 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f519a9-4696-4780-abe7-10983bebe036 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:29.873954 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f519a9-4696-4780-abe7-10983bebe036 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:29.875270 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 559/1139] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:29.880625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df87fa-3d7f-4a72-a311-e1e51a91b25b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:29.880997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df87fa-3d7f-4a72-a311-e1e51a91b25b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:29.881184 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df87fa-3d7f-4a72-a311-e1e51a91b25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:29.898891 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-92df87fa-3d7f-4a72-a311-e1e51a91b25b None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:29.900090 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-92df87fa-3d7f-4a72-a311-e1e51a91b25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:29.965169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 581/1140] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:29.988573 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f519a9-4696-4780-abe7-10983bebe036 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:30.088855 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f519a9-4696-4780-abe7-10983bebe036 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:30.123174 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefa6b4-e440-4a16-b54d-7570f91b596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:30.124010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefa6b4-e440-4a16-b54d-7570f91b596a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:30.124243 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefa6b4-e440-4a16-b54d-7570f91b596a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:30.124517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefa6b4-e440-4a16-b54d-7570f91b596a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:30.134557 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefa6b4-e440-4a16-b54d-7570f91b596a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-baefa6b4-e440-4a16-b54d-7570f91b596a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:33:30.141946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:30.143056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:30.143941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:30.143941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:30.143941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:30.143941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:30.143941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:33:30.143941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:33:30.143941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:33:30.143941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:33:30.143941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:33:30.143941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:33:30.143941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:30.143941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:30.143941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 560/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:33:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:30.149251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df87fa-3d7f-4a72-a311-e1e51a91b25b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:30.176362 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:30.246879 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df87fa-3d7f-4a72-a311-e1e51a91b25b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:30.279021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136bbc6-d3d5-4027-becc-3b494b06aae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:30.279672 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136bbc6-d3d5-4027-becc-3b494b06aae0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:30.279951 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136bbc6-d3d5-4027-becc-3b494b06aae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:30.280224 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136bbc6-d3d5-4027-becc-3b494b06aae0 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:30.280953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136bbc6-d3d5-4027-becc-3b494b06aae0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:30.281255 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136bbc6-d3d5-4027-becc-3b494b06aae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:30.282623 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136bbc6-d3d5-4027-becc-3b494b06aae0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:30.290337 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 582/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:33:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:30.296685 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefa6b4-e440-4a16-b54d-7570f91b596a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:30.309706 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:30.400724 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefa6b4-e440-4a16-b54d-7570f91b596a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:30.434679 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d7a87-6e03-4bcf-97dc-8d3e58a003db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:30.435551 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d7a87-6e03-4bcf-97dc-8d3e58a003db None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:30.435835 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d7a87-6e03-4bcf-97dc-8d3e58a003db None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:30.436110 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d7a87-6e03-4bcf-97dc-8d3e58a003db None admin] PATH_INFO: `/v3/users/4e3d31fe8e7841948c2286fb1e5f6aa5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:30.449342 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d7a87-6e03-4bcf-97dc-8d3e58a003db None admin] RBAC: Authorizing `identity:get_user(user_id=4e3d31fe8e7841948c2286fb1e5f6aa5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:30.450817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d7a87-6e03-4bcf-97dc-8d3e58a003db None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:30.452473 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 561/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:33:30 2022] GET /identity/v3/users/4e3d31fe8e7841948c2286fb1e5f6aa5 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:30.458434 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136bbc6-d3d5-4027-becc-3b494b06aae0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:30.550376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:30.560355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136bbc6-d3d5-4027-becc-3b494b06aae0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:30.593013 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaaa1a-1145-4aeb-b26b-327570748154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:30.593656 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaaa1a-1145-4aeb-b26b-327570748154 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:30.593943 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaaa1a-1145-4aeb-b26b-327570748154 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:30.594222 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaaa1a-1145-4aeb-b26b-327570748154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:30.659392 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defaaa1a-1145-4aeb-b26b-327570748154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:30.660765 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defaaa1a-1145-4aeb-b26b-327570748154 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:30.745763 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:30.756463 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 583/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:33:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:33:30.762633 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d7a87-6e03-4bcf-97dc-8d3e58a003db None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:30.827413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:30.860810 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d7a87-6e03-4bcf-97dc-8d3e58a003db None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:30.896493 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23101641-196d-40ce-a7d4-c2e7d191a203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:30.897352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23101641-196d-40ce-a7d4-c2e7d191a203 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:30.897638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23101641-196d-40ce-a7d4-c2e7d191a203 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:30.897938 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23101641-196d-40ce-a7d4-c2e7d191a203 None admin] PATH_INFO: `/v3/projects/f835baf7ddb6451282085d3123af2f94` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:30.899120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23101641-196d-40ce-a7d4-c2e7d191a203 None admin] RBAC: Authorizing `identity:get_project(project_id=f835baf7ddb6451282085d3123af2f94)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:30.900555 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23101641-196d-40ce-a7d4-c2e7d191a203 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:30.902287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 562/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:33:30 2022] GET /identity/v3/projects/f835baf7ddb6451282085d3123af2f94 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:30.909012 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaaa1a-1145-4aeb-b26b-327570748154 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:31.004744 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaaa1a-1145-4aeb-b26b-327570748154 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:31.038799 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668785f-4993-4bba-94c1-80cb885e4a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:31.039457 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668785f-4993-4bba-94c1-80cb885e4a80 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:31.039738 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668785f-4993-4bba-94c1-80cb885e4a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:31.040015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668785f-4993-4bba-94c1-80cb885e4a80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:31.040839 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668785f-4993-4bba-94c1-80cb885e4a80 None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=f835baf7ddb6451282085d3123af2f94, user.id=4e3d31fe8e7841948c2286fb1e5f6aa5) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:31.041149 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668785f-4993-4bba-94c1-80cb885e4a80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:31.042595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668785f-4993-4bba-94c1-80cb885e4a80 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:31.047987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 584/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:33:30 2022] GET /identity/v3/role_assignments?user.id=4e3d31fe8e7841948c2286fb1e5f6aa5&scope.project.id=f835baf7ddb6451282085d3123af2f94&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:33.134268 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc034245-ddf2-4c8a-82c0-ad3651948c5e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:33.134846 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc034245-ddf2-4c8a-82c0-ad3651948c5e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:33.134846 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc034245-ddf2-4c8a-82c0-ad3651948c5e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:33.136209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 563/1147] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:33.141624 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebb932-df06-44fb-be9c-28e79b9a280b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:33.142043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebb932-df06-44fb-be9c-28e79b9a280b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:33.142179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebb932-df06-44fb-be9c-28e79b9a280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:33.158615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-aeebb932-df06-44fb-be9c-28e79b9a280b None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:33.159825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-aeebb932-df06-44fb-be9c-28e79b9a280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:33.209129 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:33.226257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 585/1148] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:33.249152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc034245-ddf2-4c8a-82c0-ad3651948c5e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:33.347961 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc034245-ddf2-4c8a-82c0-ad3651948c5e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:33.382367 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d007f-1825-4029-b10c-990033778bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:33.383176 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d007f-1825-4029-b10c-990033778bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:33.383463 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d007f-1825-4029-b10c-990033778bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:33.383738 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d007f-1825-4029-b10c-990033778bd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:33.386404 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:33.394431 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d007f-1825-4029-b10c-990033778bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b49d007f-1825-4029-b10c-990033778bd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:33:33.401994 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:33.403219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:33.404359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:33.404359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:33.404359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:33.404359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:33.404359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:33:33.404359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:33:33.404359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:33:33.404359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:33:33.404359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:33:33.404359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:33:33.404359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:33.404359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:33.404359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 564/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:33:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:33.409518 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebb932-df06-44fb-be9c-28e79b9a280b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:33.508695 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebb932-df06-44fb-be9c-28e79b9a280b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:33.543192 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82615a-c21e-40ac-9bcc-506f2274e304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:33.543871 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82615a-c21e-40ac-9bcc-506f2274e304 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:33.544157 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82615a-c21e-40ac-9bcc-506f2274e304 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:33.544438 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82615a-c21e-40ac-9bcc-506f2274e304 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:33.545665 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82615a-c21e-40ac-9bcc-506f2274e304 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:33.545665 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82615a-c21e-40ac-9bcc-506f2274e304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:33.546871 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82615a-c21e-40ac-9bcc-506f2274e304 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:33.555384 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 586/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:33:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:33.561301 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d007f-1825-4029-b10c-990033778bd1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:33.667060 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d007f-1825-4029-b10c-990033778bd1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:33.699787 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbcc29-570f-45c2-80c4-7b42420efa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:33.700643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbcc29-570f-45c2-80c4-7b42420efa13 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:33.700926 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbcc29-570f-45c2-80c4-7b42420efa13 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:33.701200 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbcc29-570f-45c2-80c4-7b42420efa13 None admin] PATH_INFO: `/v3/users/4e3d31fe8e7841948c2286fb1e5f6aa5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:33.702366 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbcc29-570f-45c2-80c4-7b42420efa13 None admin] RBAC: Authorizing `identity:get_user(user_id=4e3d31fe8e7841948c2286fb1e5f6aa5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:33.703820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbcc29-570f-45c2-80c4-7b42420efa13 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:33.705413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 565/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:33:33 2022] GET /identity/v3/users/4e3d31fe8e7841948c2286fb1e5f6aa5 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:33.711232 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82615a-c21e-40ac-9bcc-506f2274e304 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:33.757876 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:33.810022 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82615a-c21e-40ac-9bcc-506f2274e304 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:33.842453 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303d0c9-17d4-43e8-b61e-b4e4f4ae535a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:33.843336 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303d0c9-17d4-43e8-b61e-b4e4f4ae535a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:33.843623 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303d0c9-17d4-43e8-b61e-b4e4f4ae535a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:33.843902 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303d0c9-17d4-43e8-b61e-b4e4f4ae535a None admin] PATH_INFO: `/v3/projects/f835baf7ddb6451282085d3123af2f94` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:33.845073 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303d0c9-17d4-43e8-b61e-b4e4f4ae535a None admin] RBAC: Authorizing `identity:get_project(project_id=f835baf7ddb6451282085d3123af2f94)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:33.846515 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303d0c9-17d4-43e8-b61e-b4e4f4ae535a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:33.848216 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 587/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:33:33 2022] GET /identity/v3/projects/f835baf7ddb6451282085d3123af2f94 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:33.854103 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbcc29-570f-45c2-80c4-7b42420efa13 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:33.916157 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:33.953792 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbcc29-570f-45c2-80c4-7b42420efa13 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:33.986352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d1d4a-bdac-4192-b7f7-b7790fd246b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:33.987254 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d1d4a-bdac-4192-b7f7-b7790fd246b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:33.987538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d1d4a-bdac-4192-b7f7-b7790fd246b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:33.987817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d1d4a-bdac-4192-b7f7-b7790fd246b7 None admin] PATH_INFO: `/v3/projects/f835baf7ddb6451282085d3123af2f94/users/4e3d31fe8e7841948c2286fb1e5f6aa5/roles/efaf387c51e14931820f2a9b33ac5175` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:33.989763 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d1d4a-bdac-4192-b7f7-b7790fd246b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f835baf7ddb6451282085d3123af2f94, user_id=4e3d31fe8e7841948c2286fb1e5f6aa5, role_id=efaf387c51e14931820f2a9b33ac5175)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:33.991231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d1d4a-bdac-4192-b7f7-b7790fd246b7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:34.004281 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 566/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:33:33 2022] PUT /identity/v3/projects/f835baf7ddb6451282085d3123af2f94/users/4e3d31fe8e7841948c2286fb1e5f6aa5/roles/efaf387c51e14931820f2a9b33ac5175 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:33:36.111853 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5d8b9-b03d-49eb-8c52-f7d6de4d26ac None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:36.112406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5d8b9-b03d-49eb-8c52-f7d6de4d26ac None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:36.112406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5d8b9-b03d-49eb-8c52-f7d6de4d26ac None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:36.113791 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 588/1154] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:36.118989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28ae14-992e-4311-9bda-692fb2fe4108 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:36.119493 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28ae14-992e-4311-9bda-692fb2fe4108 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:36.119633 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28ae14-992e-4311-9bda-692fb2fe4108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:36.137272 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-cb28ae14-992e-4311-9bda-692fb2fe4108 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:36.138469 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-cb28ae14-992e-4311-9bda-692fb2fe4108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:36.203427 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 567/1155] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:36.226387 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5d8b9-b03d-49eb-8c52-f7d6de4d26ac None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:36.328333 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5d8b9-b03d-49eb-8c52-f7d6de4d26ac None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:36.341894 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:36.362551 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5877d-2b76-4bfd-bbf3-ededcc190f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:36.363255 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5877d-2b76-4bfd-bbf3-ededcc190f94 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:36.363536 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5877d-2b76-4bfd-bbf3-ededcc190f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:36.363811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5877d-2b76-4bfd-bbf3-ededcc190f94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:36.374757 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5877d-2b76-4bfd-bbf3-ededcc190f94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f8d5877d-2b76-4bfd-bbf3-ededcc190f94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:33:36.382519 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:36.383685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:36.384761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:36.384761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:36.384761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:36.384761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:36.384761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:33:36.384761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:33:36.384761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:33:36.384761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:33:36.384761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:33:36.384761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:33:36.384761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:36.384761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:33:36.384761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 589/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:33:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:36.389708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28ae14-992e-4311-9bda-692fb2fe4108 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:36.443577 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:36.487537 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28ae14-992e-4311-9bda-692fb2fe4108 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:36.520688 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc316085-84ac-4726-bbf9-01d36d8062c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:36.521363 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc316085-84ac-4726-bbf9-01d36d8062c6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:36.521650 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc316085-84ac-4726-bbf9-01d36d8062c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:36.521927 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc316085-84ac-4726-bbf9-01d36d8062c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:36.522701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc316085-84ac-4726-bbf9-01d36d8062c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:36.523012 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc316085-84ac-4726-bbf9-01d36d8062c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:36.524366 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc316085-84ac-4726-bbf9-01d36d8062c6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:36.533096 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 568/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:33:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:36.538886 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5877d-2b76-4bfd-bbf3-ededcc190f94 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:36.634902 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5877d-2b76-4bfd-bbf3-ededcc190f94 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:36.667793 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aec6a7-efd7-433f-81c6-ea35043fae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:36.668647 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aec6a7-efd7-433f-81c6-ea35043fae26 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:36.668928 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aec6a7-efd7-433f-81c6-ea35043fae26 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:36.669198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aec6a7-efd7-433f-81c6-ea35043fae26 None admin] PATH_INFO: `/v3/users/4e3d31fe8e7841948c2286fb1e5f6aa5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:36.670365 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aec6a7-efd7-433f-81c6-ea35043fae26 None admin] RBAC: Authorizing `identity:get_user(user_id=4e3d31fe8e7841948c2286fb1e5f6aa5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:36.671798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aec6a7-efd7-433f-81c6-ea35043fae26 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:36.673398 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 590/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:33:36 2022] GET /identity/v3/users/4e3d31fe8e7841948c2286fb1e5f6aa5 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:36.679318 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc316085-84ac-4726-bbf9-01d36d8062c6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:36.775706 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc316085-84ac-4726-bbf9-01d36d8062c6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:36.791671 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:36.809727 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01f19e-1f4c-434a-816e-d6b85f49b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:36.810376 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01f19e-1f4c-434a-816e-d6b85f49b743 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:36.810694 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01f19e-1f4c-434a-816e-d6b85f49b743 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:36.810975 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01f19e-1f4c-434a-816e-d6b85f49b743 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:36.875946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01f19e-1f4c-434a-816e-d6b85f49b743 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:36.877384 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01f19e-1f4c-434a-816e-d6b85f49b743 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:36.973865 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 569/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:33:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:33:36.979734 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aec6a7-efd7-433f-81c6-ea35043fae26 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:37.021928 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:37.078208 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aec6a7-efd7-433f-81c6-ea35043fae26 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:37.111109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf58107-5351-4953-bdf4-a846fcd34d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:37.111963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf58107-5351-4953-bdf4-a846fcd34d62 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:37.112520 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf58107-5351-4953-bdf4-a846fcd34d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:37.112520 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf58107-5351-4953-bdf4-a846fcd34d62 None admin] PATH_INFO: `/v3/projects/f835baf7ddb6451282085d3123af2f94` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:37.113652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf58107-5351-4953-bdf4-a846fcd34d62 None admin] RBAC: Authorizing `identity:get_project(project_id=f835baf7ddb6451282085d3123af2f94)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:37.115103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf58107-5351-4953-bdf4-a846fcd34d62 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:37.116773 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 591/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:33:36 2022] GET /identity/v3/projects/f835baf7ddb6451282085d3123af2f94 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:37.123236 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01f19e-1f4c-434a-816e-d6b85f49b743 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:37.141095 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:37.220342 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01f19e-1f4c-434a-816e-d6b85f49b743 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:37.256343 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2b72c-3ba4-48e7-a96e-02c106b06d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:37.257017 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2b72c-3ba4-48e7-a96e-02c106b06d74 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:37.257297 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2b72c-3ba4-48e7-a96e-02c106b06d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:37.257571 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2b72c-3ba4-48e7-a96e-02c106b06d74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:37.258420 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2b72c-3ba4-48e7-a96e-02c106b06d74 None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=f835baf7ddb6451282085d3123af2f94, user.id=4e3d31fe8e7841948c2286fb1e5f6aa5) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:37.258777 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2b72c-3ba4-48e7-a96e-02c106b06d74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:37.260545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2b72c-3ba4-48e7-a96e-02c106b06d74 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:37.267903 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 570/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:33:37 2022] GET /identity/v3/role_assignments?user.id=4e3d31fe8e7841948c2286fb1e5f6aa5&scope.project.id=f835baf7ddb6451282085d3123af2f94&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:39.425118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec95d8-e643-4209-9ac4-f1dd06a32de0 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:39.425643 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec95d8-e643-4209-9ac4-f1dd06a32de0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:39.425733 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec95d8-e643-4209-9ac4-f1dd06a32de0 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:39.427072 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 592/1162] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:39.432152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861976ba-57e3-4be3-bc05-4b677cd1887a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:39.433160 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861976ba-57e3-4be3-bc05-4b677cd1887a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:39.433255 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861976ba-57e3-4be3-bc05-4b677cd1887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:39.449597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-861976ba-57e3-4be3-bc05-4b677cd1887a None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:39.450811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-861976ba-57e3-4be3-bc05-4b677cd1887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:39.521932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 571/1163] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:39.545632 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec95d8-e643-4209-9ac4-f1dd06a32de0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:39.645502 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec95d8-e643-4209-9ac4-f1dd06a32de0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:39.656418 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:39.680037 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df6b84-7801-46df-9bf7-980b50cb56fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:39.680619 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df6b84-7801-46df-9bf7-980b50cb56fe None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:39.680902 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df6b84-7801-46df-9bf7-980b50cb56fe None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:39.681178 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df6b84-7801-46df-9bf7-980b50cb56fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:39.746314 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df6b84-7801-46df-9bf7-980b50cb56fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:39.747785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df6b84-7801-46df-9bf7-980b50cb56fe None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:39.843160 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 593/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:33:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:33:39.849235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861976ba-57e3-4be3-bc05-4b677cd1887a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:39.861222 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:39.946532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861976ba-57e3-4be3-bc05-4b677cd1887a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:39.980143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37170da-47ab-4e6e-b623-f224b881f1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:39.980936 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37170da-47ab-4e6e-b623-f224b881f1dc None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:39.981218 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37170da-47ab-4e6e-b623-f224b881f1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:39.981494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37170da-47ab-4e6e-b623-f224b881f1dc None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:39.988338 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37170da-47ab-4e6e-b623-f224b881f1dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:39.989763 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37170da-47ab-4e6e-b623-f224b881f1dc None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a37170da-47ab-4e6e-b623-f224b881f1dc None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:40.003651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:40.005144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:40.006391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:40.006391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:40.006391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:40.006391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:40.006391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:40.006391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:40.006391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:40.006391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:40.006391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:40.006391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:40.006391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 15 09:33:40.006391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:33:40.006391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 15 09:33:40.006391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:40.006391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 572/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Jun 15 09:33:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:40.011788 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df6b84-7801-46df-9bf7-980b50cb56fe None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:40.023335 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:40.108461 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df6b84-7801-46df-9bf7-980b50cb56fe None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:40.141265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44831dee-905d-4743-8b42-47d30b7a45f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:40.141919 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44831dee-905d-4743-8b42-47d30b7a45f9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:40.142200 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44831dee-905d-4743-8b42-47d30b7a45f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:40.142476 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44831dee-905d-4743-8b42-47d30b7a45f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:40.143218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44831dee-905d-4743-8b42-47d30b7a45f9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:40.143522 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44831dee-905d-4743-8b42-47d30b7a45f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:40.144873 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44831dee-905d-4743-8b42-47d30b7a45f9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:40.152484 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 594/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Wed Jun 15 09:33:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:42.253284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e330b1-c838-4290-a5a0-f61f12c127f9 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:42.254057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e330b1-c838-4290-a5a0-f61f12c127f9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:42.254057 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e330b1-c838-4290-a5a0-f61f12c127f9 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:42.255454 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 573/1167] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:42.260638 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dde3d-43f0-4213-8841-4af597a9b823 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:42.261020 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dde3d-43f0-4213-8841-4af597a9b823 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:42.261230 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dde3d-43f0-4213-8841-4af597a9b823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:42.277574 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2e1dde3d-43f0-4213-8841-4af597a9b823 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:42.278795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2e1dde3d-43f0-4213-8841-4af597a9b823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:42.343561 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 595/1168] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:42.371568 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e330b1-c838-4290-a5a0-f61f12c127f9 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:42.440234 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:42.471856 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e330b1-c838-4290-a5a0-f61f12c127f9 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:42.504543 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ed678-9770-44dd-8006-784b207f6ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:42.505126 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ed678-9770-44dd-8006-784b207f6ead None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:42.505408 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ed678-9770-44dd-8006-784b207f6ead None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:42.505683 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ed678-9770-44dd-8006-784b207f6ead None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:42.506412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ed678-9770-44dd-8006-784b207f6ead None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:42.507803 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ed678-9770-44dd-8006-784b207f6ead None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:42.522306 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 574/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Wed Jun 15 09:33:42 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:33:44.669469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c3e8e-bba2-4b23-acc6-c79562bdb455 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:44.670026 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c3e8e-bba2-4b23-acc6-c79562bdb455 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:44.670026 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c3e8e-bba2-4b23-acc6-c79562bdb455 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:44.671447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 596/1170] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:44.676725 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd2dd4-937c-4830-b61d-b1ca3884b2e7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:44.677148 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd2dd4-937c-4830-b61d-b1ca3884b2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:44.677293 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd2dd4-937c-4830-b61d-b1ca3884b2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:44.693678 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-03dd2dd4-937c-4830-b61d-b1ca3884b2e7 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:44.694911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-03dd2dd4-937c-4830-b61d-b1ca3884b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:44.761409 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 575/1171] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:44.785187 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c3e8e-bba2-4b23-acc6-c79562bdb455 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:44.789015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:44.884069 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c3e8e-bba2-4b23-acc6-c79562bdb455 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:44.916836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a40474-0923-4e84-b706-19b46e603d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:44.917685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a40474-0923-4e84-b706-19b46e603d87 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:44.917966 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a40474-0923-4e84-b706-19b46e603d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:44.918241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a40474-0923-4e84-b706-19b46e603d87 None admin] PATH_INFO: `/v3/domains/9eb455fb78424a169ffb6830d14ab5a9` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:44.928393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a40474-0923-4e84-b706-19b46e603d87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9eb455fb78424a169ffb6830d14ab5a9)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:44.929827 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a40474-0923-4e84-b706-19b46e603d87 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:44.931482 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 597/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Wed Jun 15 09:33:44 2022] GET /identity/v3/domains/9eb455fb78424a169ffb6830d14ab5a9 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:44.937810 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd2dd4-937c-4830-b61d-b1ca3884b2e7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:44.995109 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:45.035955 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd2dd4-937c-4830-b61d-b1ca3884b2e7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:45.069042 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf87bb-33f8-4a0a-8cff-3f2e57ef2442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:45.069707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf87bb-33f8-4a0a-8cff-3f2e57ef2442 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:45.069993 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf87bb-33f8-4a0a-8cff-3f2e57ef2442 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:45.070272 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf87bb-33f8-4a0a-8cff-3f2e57ef2442 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:45.071022 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf87bb-33f8-4a0a-8cff-3f2e57ef2442 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:45.073089 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf87bb-33f8-4a0a-8cff-3f2e57ef2442 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:45.098257 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 576/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Jun 15 09:33:44 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:33:47.262429 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6aef21-8c98-4119-a5a4-beb98d35e299 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:47.262994 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6aef21-8c98-4119-a5a4-beb98d35e299 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:47.262994 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6aef21-8c98-4119-a5a4-beb98d35e299 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:47.264365 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 598/1174] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:47.269496 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b63845-1555-47ce-b6fc-fa103cd3dff6 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:47.269921 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b63845-1555-47ce-b6fc-fa103cd3dff6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:47.270071 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b63845-1555-47ce-b6fc-fa103cd3dff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:47.287135 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e8b63845-1555-47ce-b6fc-fa103cd3dff6 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:47.288335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e8b63845-1555-47ce-b6fc-fa103cd3dff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:47.355835 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 577/1175] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:47.380290 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6aef21-8c98-4119-a5a4-beb98d35e299 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:47.443364 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:47.483399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6aef21-8c98-4119-a5a4-beb98d35e299 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:47.516112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad6894-4c53-4bdb-9e12-e76511d87b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:47.516884 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad6894-4c53-4bdb-9e12-e76511d87b9f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:47.517188 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad6894-4c53-4bdb-9e12-e76511d87b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:47.517459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad6894-4c53-4bdb-9e12-e76511d87b9f None admin] PATH_INFO: `/v3/domains/9eb455fb78424a169ffb6830d14ab5a9` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:47.518666 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad6894-4c53-4bdb-9e12-e76511d87b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=9eb455fb78424a169ffb6830d14ab5a9)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:47.520126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad6894-4c53-4bdb-9e12-e76511d87b9f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:47.521916 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 599/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Wed Jun 15 09:33:47 2022] GET /identity/v3/domains/9eb455fb78424a169ffb6830d14ab5a9 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:47.527715 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b63845-1555-47ce-b6fc-fa103cd3dff6 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:47.571255 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:47.627595 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b63845-1555-47ce-b6fc-fa103cd3dff6 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:47.660392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78471a67-3464-4020-bebc-71bb72c51a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:47.661062 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78471a67-3464-4020-bebc-71bb72c51a72 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:47.661350 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78471a67-3464-4020-bebc-71bb72c51a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:47.661634 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78471a67-3464-4020-bebc-71bb72c51a72 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:47.662351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78471a67-3464-4020-bebc-71bb72c51a72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:47.663814 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78471a67-3464-4020-bebc-71bb72c51a72 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:47.684053 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 578/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:33:47 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 09:33:49.845971 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaba87c-b290-4ecb-90aa-7a203f3115bc None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:49.846485 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaba87c-b290-4ecb-90aa-7a203f3115bc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:49.846485 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaba87c-b290-4ecb-90aa-7a203f3115bc None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:49.847889 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 600/1178] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:49.854056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10cf29-8323-4a33-96d9-5f6c21857960 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:49.854604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10cf29-8323-4a33-96d9-5f6c21857960 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:49.854697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10cf29-8323-4a33-96d9-5f6c21857960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:49.872284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8e10cf29-8323-4a33-96d9-5f6c21857960 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:49.873511 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8e10cf29-8323-4a33-96d9-5f6c21857960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:49.951182 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 579/1179] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:49.974738 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaba87c-b290-4ecb-90aa-7a203f3115bc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:50.075256 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaba87c-b290-4ecb-90aa-7a203f3115bc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:50.104632 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:50.110112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32509f-4579-46aa-aa25-f1d31a9ece2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:50.110949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32509f-4579-46aa-aa25-f1d31a9ece2c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:50.111231 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32509f-4579-46aa-aa25-f1d31a9ece2c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:50.111503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32509f-4579-46aa-aa25-f1d31a9ece2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:50.122046 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32509f-4579-46aa-aa25-f1d31a9ece2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ca32509f-4579-46aa-aa25-f1d31a9ece2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:33:50.130147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:50.131322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:50.136452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:50.136452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:50.136452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:50.136452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:50.136452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:33:50.136452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:33:50.136452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:33:50.136452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:33:50.136452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:33:50.136452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:33:50.136452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:50.136452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:33:50.136452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 601/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:33:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:50.137401 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10cf29-8323-4a33-96d9-5f6c21857960 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:50.165010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:50.237178 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10cf29-8323-4a33-96d9-5f6c21857960 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:50.270240 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d52f7-c983-4faa-bd1b-08c5abbe764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:50.270941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d52f7-c983-4faa-bd1b-08c5abbe764d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:50.271224 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d52f7-c983-4faa-bd1b-08c5abbe764d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:50.271499 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d52f7-c983-4faa-bd1b-08c5abbe764d None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:50.272243 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d52f7-c983-4faa-bd1b-08c5abbe764d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:50.272549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d52f7-c983-4faa-bd1b-08c5abbe764d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:50.273913 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d52f7-c983-4faa-bd1b-08c5abbe764d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:50.282379 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 580/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:33:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:50.288338 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32509f-4579-46aa-aa25-f1d31a9ece2c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:50.388574 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32509f-4579-46aa-aa25-f1d31a9ece2c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:50.421359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b47d0-6410-4c46-9715-1bf04b4e4840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:50.422225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b47d0-6410-4c46-9715-1bf04b4e4840 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:50.422529 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b47d0-6410-4c46-9715-1bf04b4e4840 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:50.422808 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b47d0-6410-4c46-9715-1bf04b4e4840 None admin] PATH_INFO: `/v3/users/071971340a5b4c9d8d9a90a96247ced4` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:50.435841 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b47d0-6410-4c46-9715-1bf04b4e4840 None admin] RBAC: Authorizing `identity:get_user(user_id=071971340a5b4c9d8d9a90a96247ced4)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:50.437262 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b47d0-6410-4c46-9715-1bf04b4e4840 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:50.438954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 602/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:33:50 2022] GET /identity/v3/users/071971340a5b4c9d8d9a90a96247ced4 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:50.444794 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d52f7-c983-4faa-bd1b-08c5abbe764d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:50.534729 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:50.545101 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d52f7-c983-4faa-bd1b-08c5abbe764d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:50.577795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ae4d4-ffcb-4e4d-b4f1-a12a256443e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:50.578438 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ae4d4-ffcb-4e4d-b4f1-a12a256443e5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:50.578756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ae4d4-ffcb-4e4d-b4f1-a12a256443e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:50.579040 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ae4d4-ffcb-4e4d-b4f1-a12a256443e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:50.646211 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ae4d4-ffcb-4e4d-b4f1-a12a256443e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:50.647617 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ae4d4-ffcb-4e4d-b4f1-a12a256443e5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:50.733768 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:50.744770 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 581/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:33:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 09:33:50.750718 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b47d0-6410-4c46-9715-1bf04b4e4840 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:50.799803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:50.850083 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b47d0-6410-4c46-9715-1bf04b4e4840 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:50.883819 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4022031-7a90-43bc-900b-84558ae9130c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:50.885305 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4022031-7a90-43bc-900b-84558ae9130c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:50.885586 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4022031-7a90-43bc-900b-84558ae9130c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:50.885863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4022031-7a90-43bc-900b-84558ae9130c None admin] PATH_INFO: `/v3/projects/d524066fabfb422785bc3ad4f2b00a00` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:50.887072 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4022031-7a90-43bc-900b-84558ae9130c None admin] RBAC: Authorizing `identity:get_project(project_id=d524066fabfb422785bc3ad4f2b00a00)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:50.888489 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4022031-7a90-43bc-900b-84558ae9130c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:50.890194 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 603/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:33:50 2022] GET /identity/v3/projects/d524066fabfb422785bc3ad4f2b00a00 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:50.896396 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ae4d4-ffcb-4e4d-b4f1-a12a256443e5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:50.992334 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ae4d4-ffcb-4e4d-b4f1-a12a256443e5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:51.026398 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14dcbd-a1fd-46ba-9337-78e8bfe3897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:51.027070 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14dcbd-a1fd-46ba-9337-78e8bfe3897c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:51.027353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14dcbd-a1fd-46ba-9337-78e8bfe3897c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:51.027627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14dcbd-a1fd-46ba-9337-78e8bfe3897c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:51.028447 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14dcbd-a1fd-46ba-9337-78e8bfe3897c None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=d524066fabfb422785bc3ad4f2b00a00, user.id=071971340a5b4c9d8d9a90a96247ced4) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:51.028757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14dcbd-a1fd-46ba-9337-78e8bfe3897c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:51.030175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14dcbd-a1fd-46ba-9337-78e8bfe3897c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:51.035491 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 582/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:33:50 2022] GET /identity/v3/role_assignments?user.id=071971340a5b4c9d8d9a90a96247ced4&scope.project.id=d524066fabfb422785bc3ad4f2b00a00&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:53.113393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea63d9d-88c0-4590-97d4-7a84ebe45ef3 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:53.113989 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea63d9d-88c0-4590-97d4-7a84ebe45ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:53.113989 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea63d9d-88c0-4590-97d4-7a84ebe45ef3 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:53.115357 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 604/1186] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:53.121166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c8183-01f9-4f4b-b72d-553611e62eb1 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:53.121653 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c8183-01f9-4f4b-b72d-553611e62eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:53.121738 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c8183-01f9-4f4b-b72d-553611e62eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:53.139008 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ec2c8183-01f9-4f4b-b72d-553611e62eb1 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:53.140238 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ec2c8183-01f9-4f4b-b72d-553611e62eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:53.191411 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:53.209979 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 583/1187] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:53.233368 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea63d9d-88c0-4590-97d4-7a84ebe45ef3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:53.333641 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea63d9d-88c0-4590-97d4-7a84ebe45ef3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:53.351750 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:53.369185 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa09fb-de19-4077-abd2-14f5f2b42e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:53.369909 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa09fb-de19-4077-abd2-14f5f2b42e3f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:53.370191 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa09fb-de19-4077-abd2-14f5f2b42e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:53.370474 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa09fb-de19-4077-abd2-14f5f2b42e3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:53.380764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa09fb-de19-4077-abd2-14f5f2b42e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-99fa09fb-de19-4077-abd2-14f5f2b42e3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:33:53.388954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:53.390043 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:53.390956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:53.390956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:53.390956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:53.390956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:53.390956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:33:53.390956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:33:53.390956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:33:53.390956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:33:53.390956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:33:53.390956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:33:53.390956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:53.390956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:33:53.390956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 605/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:33:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:53.396370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c8183-01f9-4f4b-b72d-553611e62eb1 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:53.493437 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c8183-01f9-4f4b-b72d-553611e62eb1 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:53.527759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c11e28-911d-418f-8467-3ca522c0eb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:53.528427 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c11e28-911d-418f-8467-3ca522c0eb50 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:53.528712 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c11e28-911d-418f-8467-3ca522c0eb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:53.528988 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c11e28-911d-418f-8467-3ca522c0eb50 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:53.529730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c11e28-911d-418f-8467-3ca522c0eb50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:53.530040 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c11e28-911d-418f-8467-3ca522c0eb50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:53.531427 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c11e28-911d-418f-8467-3ca522c0eb50 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:53.539536 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 584/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:33:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:53.545313 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa09fb-de19-4077-abd2-14f5f2b42e3f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:53.645253 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa09fb-de19-4077-abd2-14f5f2b42e3f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:53.678275 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134d997-fd6f-4f45-a9d6-0290287286e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:53.679155 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134d997-fd6f-4f45-a9d6-0290287286e0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:53.679433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134d997-fd6f-4f45-a9d6-0290287286e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:53.679704 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134d997-fd6f-4f45-a9d6-0290287286e0 None admin] PATH_INFO: `/v3/users/071971340a5b4c9d8d9a90a96247ced4` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:53.680875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134d997-fd6f-4f45-a9d6-0290287286e0 None admin] RBAC: Authorizing `identity:get_user(user_id=071971340a5b4c9d8d9a90a96247ced4)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:53.682289 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134d997-fd6f-4f45-a9d6-0290287286e0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:53.683945 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 606/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:33:53 2022] GET /identity/v3/users/071971340a5b4c9d8d9a90a96247ced4 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:53.689695 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c11e28-911d-418f-8467-3ca522c0eb50 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:53.736692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:53.790205 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c11e28-911d-418f-8467-3ca522c0eb50 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:53.824141 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d347d5-b8b6-4eb5-a03f-5cc5b6b55446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:53.825001 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d347d5-b8b6-4eb5-a03f-5cc5b6b55446 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:53.825290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d347d5-b8b6-4eb5-a03f-5cc5b6b55446 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:53.825569 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d347d5-b8b6-4eb5-a03f-5cc5b6b55446 None admin] PATH_INFO: `/v3/projects/d524066fabfb422785bc3ad4f2b00a00` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:53.826795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d347d5-b8b6-4eb5-a03f-5cc5b6b55446 None admin] RBAC: Authorizing `identity:get_project(project_id=d524066fabfb422785bc3ad4f2b00a00)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:53.828222 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d347d5-b8b6-4eb5-a03f-5cc5b6b55446 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:53.829913 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 585/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:33:53 2022] GET /identity/v3/projects/d524066fabfb422785bc3ad4f2b00a00 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:53.835932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134d997-fd6f-4f45-a9d6-0290287286e0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:53.881600 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:53.934393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134d997-fd6f-4f45-a9d6-0290287286e0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:53.966958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4909d0a-33da-448b-a31f-c8423496ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:53.967830 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4909d0a-33da-448b-a31f-c8423496ce10 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:53.968116 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4909d0a-33da-448b-a31f-c8423496ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:53.968397 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4909d0a-33da-448b-a31f-c8423496ce10 None admin] PATH_INFO: `/v3/projects/d524066fabfb422785bc3ad4f2b00a00/users/071971340a5b4c9d8d9a90a96247ced4/roles/efaf387c51e14931820f2a9b33ac5175` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:53.970352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4909d0a-33da-448b-a31f-c8423496ce10 None admin] RBAC: Authorizing `identity:create_grant(project_id=d524066fabfb422785bc3ad4f2b00a00, user_id=071971340a5b4c9d8d9a90a96247ced4, role_id=efaf387c51e14931820f2a9b33ac5175)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:53.971804 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4909d0a-33da-448b-a31f-c8423496ce10 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:53.984138 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 607/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:33:53 2022] PUT /identity/v3/projects/d524066fabfb422785bc3ad4f2b00a00/users/071971340a5b4c9d8d9a90a96247ced4/roles/efaf387c51e14931820f2a9b33ac5175 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:33:56.107137 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0735dbd-3adb-4e1f-90dd-8a8658c9275d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:56.107697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0735dbd-3adb-4e1f-90dd-8a8658c9275d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:56.107697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0735dbd-3adb-4e1f-90dd-8a8658c9275d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:56.109040 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 586/1193] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:33:56.114173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f287e2-eecf-466d-8930-d4f7bbe6e26c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:56.114595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f287e2-eecf-466d-8930-d4f7bbe6e26c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:56.114761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f287e2-eecf-466d-8930-d4f7bbe6e26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:56.131552 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a1f287e2-eecf-466d-8930-d4f7bbe6e26c None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:33:56.132735 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a1f287e2-eecf-466d-8930-d4f7bbe6e26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:33:56.198041 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 608/1194] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:33:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:33:56.221512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0735dbd-3adb-4e1f-90dd-8a8658c9275d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:56.322143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0735dbd-3adb-4e1f-90dd-8a8658c9275d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:56.336094 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:56.357117 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a4e30-1dee-488f-9b4f-4e081012938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:56.357974 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a4e30-1dee-488f-9b4f-4e081012938c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:56.358201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a4e30-1dee-488f-9b4f-4e081012938c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:56.358478 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a4e30-1dee-488f-9b4f-4e081012938c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:56.369012 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a4e30-1dee-488f-9b4f-4e081012938c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-e72a4e30-1dee-488f-9b4f-4e081012938c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:33:56.376545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:33:56.377946 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:33:56.379185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:33:56.379185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:33:56.379185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:33:56.379185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:33:56.379185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:33:56.379185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:33:56.379185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:33:56.379185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:33:56.379185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:33:56.379185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:33:56.379185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:33:56.379185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:33:56.379185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 587/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:33:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:33:56.384578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f287e2-eecf-466d-8930-d4f7bbe6e26c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:56.417932 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:56.481815 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f287e2-eecf-466d-8930-d4f7bbe6e26c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:56.515241 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919c682-2647-4eab-9f13-4429be1e316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:56.515907 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919c682-2647-4eab-9f13-4429be1e316f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:56.516188 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919c682-2647-4eab-9f13-4429be1e316f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:56.516463 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919c682-2647-4eab-9f13-4429be1e316f None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:56.517204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919c682-2647-4eab-9f13-4429be1e316f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:56.517509 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919c682-2647-4eab-9f13-4429be1e316f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:56.518918 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919c682-2647-4eab-9f13-4429be1e316f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:56.527688 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 609/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:33:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:56.533665 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a4e30-1dee-488f-9b4f-4e081012938c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:56.632098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a4e30-1dee-488f-9b4f-4e081012938c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:56.667251 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97542dff-b440-4d0b-b53b-28f3b75fc96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:56.668105 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97542dff-b440-4d0b-b53b-28f3b75fc96a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:56.668385 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97542dff-b440-4d0b-b53b-28f3b75fc96a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:56.668657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97542dff-b440-4d0b-b53b-28f3b75fc96a None admin] PATH_INFO: `/v3/users/071971340a5b4c9d8d9a90a96247ced4` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:56.669834 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97542dff-b440-4d0b-b53b-28f3b75fc96a None admin] RBAC: Authorizing `identity:get_user(user_id=071971340a5b4c9d8d9a90a96247ced4)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:56.671293 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97542dff-b440-4d0b-b53b-28f3b75fc96a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:56.672891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 588/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Wed Jun 15 09:33:56 2022] GET /identity/v3/users/071971340a5b4c9d8d9a90a96247ced4 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:56.678762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919c682-2647-4eab-9f13-4429be1e316f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:56.774316 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:56.778023 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919c682-2647-4eab-9f13-4429be1e316f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:56.810974 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa1de7-2130-48f3-be07-f934b39bb4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:56.811612 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa1de7-2130-48f3-be07-f934b39bb4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:56.811896 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa1de7-2130-48f3-be07-f934b39bb4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:56.812173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa1de7-2130-48f3-be07-f934b39bb4d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:56.877116 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa1de7-2130-48f3-be07-f934b39bb4d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:56.878843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa1de7-2130-48f3-be07-f934b39bb4d0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:56.972290 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:56.978564 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 610/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:33:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:33:56.982731 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97542dff-b440-4d0b-b53b-28f3b75fc96a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:57.026425 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:33:57.081449 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97542dff-b440-4d0b-b53b-28f3b75fc96a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:57.114467 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abd5bd-e56d-457a-97c9-6b67e306d477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:57.115349 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abd5bd-e56d-457a-97c9-6b67e306d477 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:57.115633 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abd5bd-e56d-457a-97c9-6b67e306d477 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:57.115908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abd5bd-e56d-457a-97c9-6b67e306d477 None admin] PATH_INFO: `/v3/projects/d524066fabfb422785bc3ad4f2b00a00` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:57.117078 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abd5bd-e56d-457a-97c9-6b67e306d477 None admin] RBAC: Authorizing `identity:get_project(project_id=d524066fabfb422785bc3ad4f2b00a00)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:57.119123 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abd5bd-e56d-457a-97c9-6b67e306d477 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:57.120796 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 589/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Wed Jun 15 09:33:56 2022] GET /identity/v3/projects/d524066fabfb422785bc3ad4f2b00a00 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:33:57.127010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa1de7-2130-48f3-be07-f934b39bb4d0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:33:57.222419 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa1de7-2130-48f3-be07-f934b39bb4d0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:33:57.256216 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1916b0-6130-4943-83fb-ac8b4c36c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:33:57.256858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1916b0-6130-4943-83fb-ac8b4c36c3de None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:33:57.257136 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1916b0-6130-4943-83fb-ac8b4c36c3de None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:33:57.257407 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1916b0-6130-4943-83fb-ac8b4c36c3de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:33:57.258540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1916b0-6130-4943-83fb-ac8b4c36c3de None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=d524066fabfb422785bc3ad4f2b00a00, user.id=071971340a5b4c9d8d9a90a96247ced4) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:33:57.258853 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1916b0-6130-4943-83fb-ac8b4c36c3de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:33:57.260272 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1916b0-6130-4943-83fb-ac8b4c36c3de None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:33:57.265907 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 611/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:33:57 2022] GET /identity/v3/role_assignments?user.id=071971340a5b4c9d8d9a90a96247ced4&scope.project.id=d524066fabfb422785bc3ad4f2b00a00&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:34:07.110657 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=45 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:34:07.263327 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=69 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:34:54.321401 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de389362-7691-4fde-8f73-bb28b33d6217 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:54.322066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de389362-7691-4fde-8f73-bb28b33d6217 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:54.322066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de389362-7691-4fde-8f73-bb28b33d6217 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:54.323347 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 590/1201] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:34:54.330546 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba376a7-a7a4-4ddf-a123-eef0235a9da9 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:54.330546 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba376a7-a7a4-4ddf-a123-eef0235a9da9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:54.331217 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba376a7-a7a4-4ddf-a123-eef0235a9da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:54.350075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1ba376a7-a7a4-4ddf-a123-eef0235a9da9 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:34:54.351597 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1ba376a7-a7a4-4ddf-a123-eef0235a9da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:34:54.446403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 612/1202] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:34:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:34:54.475270 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de389362-7691-4fde-8f73-bb28b33d6217 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:34:54.628989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de389362-7691-4fde-8f73-bb28b33d6217 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:34:54.670146 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780159dc-492b-4c8c-a469-3c228aa33aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:34:54.671067 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780159dc-492b-4c8c-a469-3c228aa33aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:54.671357 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780159dc-492b-4c8c-a469-3c228aa33aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:54.671629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780159dc-492b-4c8c-a469-3c228aa33aa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:54.685043 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780159dc-492b-4c8c-a469-3c228aa33aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:34:54.686794 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780159dc-492b-4c8c-a469-3c228aa33aa9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:34:54.706018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-780159dc-492b-4c8c-a469-3c228aa33aa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:34:54.706018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:34:54.706018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:34:54.706018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:34:54.706018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:34:54.706018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:34:54.706018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:34:54.706018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:34:54.706018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:34:54.706018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:34:54.706018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:34:54.706018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:34:54.706018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:34:54.706018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:34:54.706018 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:34:54.707120 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:34:54.711243 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:34:54.711243 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:34:54.711243 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:34:54.711243 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:34:54.711243 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 591/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:34:54.713693 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba376a7-a7a4-4ddf-a123-eef0235a9da9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:34:54.836175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba376a7-a7a4-4ddf-a123-eef0235a9da9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:34:54.871455 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:34:54.878222 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ec701-4db5-4ba6-8f3a-d334e1475e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:34:54.879064 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ec701-4db5-4ba6-8f3a-d334e1475e0d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:54.879311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ec701-4db5-4ba6-8f3a-d334e1475e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:54.879669 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ec701-4db5-4ba6-8f3a-d334e1475e0d None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:54.880407 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ec701-4db5-4ba6-8f3a-d334e1475e0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:34:54.881162 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ec701-4db5-4ba6-8f3a-d334e1475e0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:34:54.882881 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ec701-4db5-4ba6-8f3a-d334e1475e0d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:34:54.897106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 613/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:34:54.903387 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780159dc-492b-4c8c-a469-3c228aa33aa9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:34:54.965408 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:34:55.023472 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780159dc-492b-4c8c-a469-3c228aa33aa9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:34:55.068012 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e0509-1d1d-44b7-ac5b-d1c1bd5ac725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:34:55.068696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e0509-1d1d-44b7-ac5b-d1c1bd5ac725 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:55.069015 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e0509-1d1d-44b7-ac5b-d1c1bd5ac725 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:55.069322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e0509-1d1d-44b7-ac5b-d1c1bd5ac725 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:55.070036 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e0509-1d1d-44b7-ac5b-d1c1bd5ac725 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:34:55.071508 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e0509-1d1d-44b7-ac5b-d1c1bd5ac725 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:34:55.097220 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 592/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Wed Jun 15 09:34:54 2022] POST /identity/v3/users => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 09:34:57.535322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44b0ec-25b3-40c0-b8d8-0da101a4903c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:57.535898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44b0ec-25b3-40c0-b8d8-0da101a4903c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:57.535898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44b0ec-25b3-40c0-b8d8-0da101a4903c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:57.537515 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 614/1206] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:34:57.544552 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed843b-1ea5-4f52-9be4-1e2d7a451a02 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:57.544552 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed843b-1ea5-4f52-9be4-1e2d7a451a02 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:57.544552 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed843b-1ea5-4f52-9be4-1e2d7a451a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:57.574474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a8ed843b-1ea5-4f52-9be4-1e2d7a451a02 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:34:57.574474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a8ed843b-1ea5-4f52-9be4-1e2d7a451a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:34:57.651141 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 593/1207] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:34:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:34:57.674726 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44b0ec-25b3-40c0-b8d8-0da101a4903c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:34:57.808322 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44b0ec-25b3-40c0-b8d8-0da101a4903c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:34:57.862535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addfe53-d7fc-4e06-82fc-ece9d8efa98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:34:57.863301 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addfe53-d7fc-4e06-82fc-ece9d8efa98e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:57.863583 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addfe53-d7fc-4e06-82fc-ece9d8efa98e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:57.863853 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addfe53-d7fc-4e06-82fc-ece9d8efa98e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:57.878033 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addfe53-d7fc-4e06-82fc-ece9d8efa98e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8addfe53-d7fc-4e06-82fc-ece9d8efa98e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:34:57.886987 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:34:57.888454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:34:57.889507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:34:57.889507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:34:57.889507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:34:57.889507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:34:57.889507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:34:57.889507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:34:57.889507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:34:57.889507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:34:57.889507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:34:57.889507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:34:57.889507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:34:57.889507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:34:57.889507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 615/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:34:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:34:57.894872 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed843b-1ea5-4f52-9be4-1e2d7a451a02 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:34:57.944429 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:34:58.039918 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed843b-1ea5-4f52-9be4-1e2d7a451a02 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:34:58.091460 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147151f-d0bd-4661-b3f3-666e65892cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:34:58.092099 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147151f-d0bd-4661-b3f3-666e65892cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:58.092426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147151f-d0bd-4661-b3f3-666e65892cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:58.092746 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147151f-d0bd-4661-b3f3-666e65892cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:58.093685 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147151f-d0bd-4661-b3f3-666e65892cc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:34:58.094060 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147151f-d0bd-4661-b3f3-666e65892cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:34:58.096139 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147151f-d0bd-4661-b3f3-666e65892cc1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:34:58.107575 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 594/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:34:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:34:58.114258 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addfe53-d7fc-4e06-82fc-ece9d8efa98e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:34:58.196423 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:34:58.259196 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addfe53-d7fc-4e06-82fc-ece9d8efa98e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:34:58.302126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1071079-e1c4-40ba-a3b1-6055d2d6d218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:34:58.302929 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1071079-e1c4-40ba-a3b1-6055d2d6d218 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:58.303245 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1071079-e1c4-40ba-a3b1-6055d2d6d218 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:58.303495 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1071079-e1c4-40ba-a3b1-6055d2d6d218 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:58.315603 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1071079-e1c4-40ba-a3b1-6055d2d6d218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:34:58.317197 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1071079-e1c4-40ba-a3b1-6055d2d6d218 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:34:58.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-b1071079-e1c4-40ba-a3b1-6055d2d6d218 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:34:58.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:34:58.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:34:58.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:34:58.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:34:58.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:34:58.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:34:58.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:34:58.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:34:58.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:34:58.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:34:58.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:34:58.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:34:58.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:34:58.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:34:58.342662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:34:58.344164 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:34:58.344164 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:34:58.344164 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:34:58.344164 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:34:58.344164 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 616/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:34:58.349153 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147151f-d0bd-4661-b3f3-666e65892cc1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:34:58.513767 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:34:58.518525 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147151f-d0bd-4661-b3f3-666e65892cc1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:34:58.569347 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7d45b-57f0-4138-a14d-0769ba01549f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:34:58.570444 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7d45b-57f0-4138-a14d-0769ba01549f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:58.570873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7d45b-57f0-4138-a14d-0769ba01549f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:58.571287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7d45b-57f0-4138-a14d-0769ba01549f None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:58.572179 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7d45b-57f0-4138-a14d-0769ba01549f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:34:58.572622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7d45b-57f0-4138-a14d-0769ba01549f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:34:58.574586 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7d45b-57f0-4138-a14d-0769ba01549f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:34:58.591359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 595/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:34:58.597540 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1071079-e1c4-40ba-a3b1-6055d2d6d218 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:34:58.716955 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1071079-e1c4-40ba-a3b1-6055d2d6d218 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:34:58.721860 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:34:58.763247 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6ecc3-941e-443a-99c1-10cdf7ff68a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:34:58.764068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6ecc3-941e-443a-99c1-10cdf7ff68a4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:58.764355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6ecc3-941e-443a-99c1-10cdf7ff68a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:58.764631 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6ecc3-941e-443a-99c1-10cdf7ff68a4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:58.773276 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6ecc3-941e-443a-99c1-10cdf7ff68a4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:34:58.774791 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6ecc3-941e-443a-99c1-10cdf7ff68a4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9cf6ecc3-941e-443a-99c1-10cdf7ff68a4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:34:58.790652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:34:58.793481 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:34:58.794557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:34:58.794557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:34:58.794557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:34:58.794557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:34:58.794557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:34:58.794557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:34:58.794557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:34:58.794557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:34:58.794557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 09:34:58.794557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:34:58.794557 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 617/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:34:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:34:58.798190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7d45b-57f0-4138-a14d-0769ba01549f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:34:58.918562 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7d45b-57f0-4138-a14d-0769ba01549f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:34:58.964912 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d0876-6102-4ab8-8b97-c88297ac4923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:34:58.965785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d0876-6102-4ab8-8b97-c88297ac4923 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:58.966072 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d0876-6102-4ab8-8b97-c88297ac4923 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:58.966367 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d0876-6102-4ab8-8b97-c88297ac4923 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:58.967259 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d0876-6102-4ab8-8b97-c88297ac4923 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:34:58.967573 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d0876-6102-4ab8-8b97-c88297ac4923 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:34:58.969440 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d0876-6102-4ab8-8b97-c88297ac4923 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:34:58.994539 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 596/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Jun 15 09:34:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:34:58.997065 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6ecc3-941e-443a-99c1-10cdf7ff68a4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:34:59.127925 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6ecc3-941e-443a-99c1-10cdf7ff68a4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:34:59.171708 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666284f-190b-422f-b17a-d99d75194cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:34:59.171708 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666284f-190b-422f-b17a-d99d75194cfc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:59.171708 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666284f-190b-422f-b17a-d99d75194cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:59.172103 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666284f-190b-422f-b17a-d99d75194cfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:59.221117 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:34:59.274842 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666284f-190b-422f-b17a-d99d75194cfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:34:59.277556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666284f-190b-422f-b17a-d99d75194cfc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:34:59.400470 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 618/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:34:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:34:59.406272 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d0876-6102-4ab8-8b97-c88297ac4923 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:34:59.437054 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:34:59.536965 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d0876-6102-4ab8-8b97-c88297ac4923 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:34:59.576662 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa705062-8e84-4368-b099-b24d28574cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:34:59.577494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa705062-8e84-4368-b099-b24d28574cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:59.577745 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa705062-8e84-4368-b099-b24d28574cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:59.578022 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa705062-8e84-4368-b099-b24d28574cb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:59.590041 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa705062-8e84-4368-b099-b24d28574cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:34:59.591638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa705062-8e84-4368-b099-b24d28574cb8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:34:59.611544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-aa705062-8e84-4368-b099-b24d28574cb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:34:59.611544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:34:59.611544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:34:59.611544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:34:59.611544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:34:59.611544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:34:59.611544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:34:59.611544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:34:59.611544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:34:59.611544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:34:59.611544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:34:59.611544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:34:59.611544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:34:59.611544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:34:59.611544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:34:59.612648 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:34:59.618322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:34:59.618322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:34:59.618322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:34:59.618322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:34:59.618322 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 597/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:34:59.618633 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666284f-190b-422f-b17a-d99d75194cfc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:34:59.685116 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:34:59.732318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666284f-190b-422f-b17a-d99d75194cfc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:34:59.776407 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8d46a-e1e3-413e-9c80-c726f1e27710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:34:59.777186 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8d46a-e1e3-413e-9c80-c726f1e27710 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:59.777486 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8d46a-e1e3-413e-9c80-c726f1e27710 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:59.777767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8d46a-e1e3-413e-9c80-c726f1e27710 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:59.778518 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8d46a-e1e3-413e-9c80-c726f1e27710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:34:59.778834 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8d46a-e1e3-413e-9c80-c726f1e27710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:34:59.780199 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8d46a-e1e3-413e-9c80-c726f1e27710 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:34:59.796788 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 619/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:34:59.798596 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa705062-8e84-4368-b099-b24d28574cb8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:34:59.878148 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:34:59.910327 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa705062-8e84-4368-b099-b24d28574cb8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:34:59.953517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e590206-66e7-49c6-814b-7ab96e7f5850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:34:59.954619 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e590206-66e7-49c6-814b-7ab96e7f5850 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:34:59.955017 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e590206-66e7-49c6-814b-7ab96e7f5850 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:34:59.955421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e590206-66e7-49c6-814b-7ab96e7f5850 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:34:59.963108 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e590206-66e7-49c6-814b-7ab96e7f5850 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:34:59.964681 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e590206-66e7-49c6-814b-7ab96e7f5850 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:34:59.979056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7e590206-66e7-49c6-814b-7ab96e7f5850 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:34:59.979056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:34:59.979056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:34:59.979056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:34:59.979056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:34:59.979056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:34:59.979056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:34:59.979056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:34:59.979056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:34:59.979056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:34:59.979056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:34:59.979056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:34:59.979056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:34:59.979056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:34:59.979056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:34:59.987646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:34:59.988757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:34:59.988757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:34:59.988757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:34:59.988757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:34:59.988757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:34:59.988757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:34:59.988757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:34:59.988757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:34:59.988757 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 598/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:34:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:34:59.989397 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8d46a-e1e3-413e-9c80-c726f1e27710 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:00.107237 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8d46a-e1e3-413e-9c80-c726f1e27710 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:00.135654 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:00.155742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39f66f-c446-47b8-abe8-5d0241e54a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:00.156698 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39f66f-c446-47b8-abe8-5d0241e54a3f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:00.157547 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39f66f-c446-47b8-abe8-5d0241e54a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:00.157893 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39f66f-c446-47b8-abe8-5d0241e54a3f None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:00.158949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39f66f-c446-47b8-abe8-5d0241e54a3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:00.159358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39f66f-c446-47b8-abe8-5d0241e54a3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:00.161191 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39f66f-c446-47b8-abe8-5d0241e54a3f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:00.177722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 620/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:34:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:35:00.183538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e590206-66e7-49c6-814b-7ab96e7f5850 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:00.292408 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e590206-66e7-49c6-814b-7ab96e7f5850 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:00.330479 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:00.338530 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8e6c2-c857-4e4e-a88d-feb7179c21fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:00.339356 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8e6c2-c857-4e4e-a88d-feb7179c21fa None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:00.339700 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8e6c2-c857-4e4e-a88d-feb7179c21fa None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:00.340043 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8e6c2-c857-4e4e-a88d-feb7179c21fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:00.341056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8e6c2-c857-4e4e-a88d-feb7179c21fa None admin] RBAC: Adding query filter params (role.id=0ff0d3dcb5e448c3abc2470461490795, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=ebadf82546c5464ab21a467a50c70513) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:00.341378 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8e6c2-c857-4e4e-a88d-feb7179c21fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:00.342976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8e6c2-c857-4e4e-a88d-feb7179c21fa None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:00.350914 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 599/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:35:00 2022] GET /identity/v3/role_assignments?user.id=ebadf82546c5464ab21a467a50c70513&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=0ff0d3dcb5e448c3abc2470461490795 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:02.528775 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b075f-7904-4c0d-acf2-9ec97f1d43f4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:02.529385 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b075f-7904-4c0d-acf2-9ec97f1d43f4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:02.529385 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b075f-7904-4c0d-acf2-9ec97f1d43f4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:02.530883 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 621/1220] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:35:02.537774 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891734bf-4209-42fe-a52c-13394adbd605 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:02.538355 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891734bf-4209-42fe-a52c-13394adbd605 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:02.538355 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891734bf-4209-42fe-a52c-13394adbd605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:02.559066 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-891734bf-4209-42fe-a52c-13394adbd605 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:35:02.560304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-891734bf-4209-42fe-a52c-13394adbd605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:35:02.637229 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 600/1221] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:35:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:35:02.661237 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b075f-7904-4c0d-acf2-9ec97f1d43f4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:02.782574 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b075f-7904-4c0d-acf2-9ec97f1d43f4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:02.818945 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e5313-2581-42b5-9132-8ed98c8bd7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:02.819843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e5313-2581-42b5-9132-8ed98c8bd7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:02.820109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e5313-2581-42b5-9132-8ed98c8bd7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:02.820431 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e5313-2581-42b5-9132-8ed98c8bd7c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:02.834611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e5313-2581-42b5-9132-8ed98c8bd7c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-3e8e5313-2581-42b5-9132-8ed98c8bd7c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:35:02.842621 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:02.843875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:02.845473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:02.845473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:02.845473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:02.845473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:02.845473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:35:02.845473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:35:02.845473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:35:02.845473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:35:02.845473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:35:02.845473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:35:02.845473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:35:02.845473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:02.845473 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 622/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:35:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:02.850944 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891734bf-4209-42fe-a52c-13394adbd605 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:02.969022 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891734bf-4209-42fe-a52c-13394adbd605 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:02.997600 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:03.011247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9530340-b437-4e28-9bcc-100136f59710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:03.011937 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9530340-b437-4e28-9bcc-100136f59710 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:03.012227 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9530340-b437-4e28-9bcc-100136f59710 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:03.012511 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9530340-b437-4e28-9bcc-100136f59710 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:03.013262 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9530340-b437-4e28-9bcc-100136f59710 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:03.013577 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9530340-b437-4e28-9bcc-100136f59710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:03.015014 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9530340-b437-4e28-9bcc-100136f59710 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:03.026577 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 601/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:35:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:03.036040 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e5313-2581-42b5-9132-8ed98c8bd7c1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:03.085590 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:03.162596 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e5313-2581-42b5-9132-8ed98c8bd7c1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:03.203115 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dd1f3-5536-4209-a7f9-0b6ccc06ee2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:03.204754 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dd1f3-5536-4209-a7f9-0b6ccc06ee2b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:03.205046 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dd1f3-5536-4209-a7f9-0b6ccc06ee2b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:03.205325 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dd1f3-5536-4209-a7f9-0b6ccc06ee2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:03.216661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18dd1f3-5536-4209-a7f9-0b6ccc06ee2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:03.218095 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18dd1f3-5536-4209-a7f9-0b6ccc06ee2b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:03.237252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e18dd1f3-5536-4209-a7f9-0b6ccc06ee2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:03.237252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:03.237252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:03.237252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:03.237252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:03.237252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:03.237252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:03.237252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:03.237252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:03.237252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:03.237252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:03.237252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:03.237252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:35:03.237252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:35:03.237252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:03.238399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:03.239832 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:35:03.239832 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:35:03.239832 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:03.239832 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:03.241515 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 623/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:35:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:03.248272 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9530340-b437-4e28-9bcc-100136f59710 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:03.358659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9530340-b437-4e28-9bcc-100136f59710 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:03.398870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807aaee-eb03-486e-b80a-be8eab7c585a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:03.399645 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807aaee-eb03-486e-b80a-be8eab7c585a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:03.399939 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807aaee-eb03-486e-b80a-be8eab7c585a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:03.400286 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807aaee-eb03-486e-b80a-be8eab7c585a None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:03.401131 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807aaee-eb03-486e-b80a-be8eab7c585a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:03.401442 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807aaee-eb03-486e-b80a-be8eab7c585a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:03.403064 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807aaee-eb03-486e-b80a-be8eab7c585a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:03.417614 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 602/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:03.423286 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dd1f3-5536-4209-a7f9-0b6ccc06ee2b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:03.522110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:03.530520 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dd1f3-5536-4209-a7f9-0b6ccc06ee2b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:03.571097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f7d72-27d0-4b99-9c0e-e2aafe68fa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:03.571982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f7d72-27d0-4b99-9c0e-e2aafe68fa7b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:03.572301 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f7d72-27d0-4b99-9c0e-e2aafe68fa7b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:03.572652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f7d72-27d0-4b99-9c0e-e2aafe68fa7b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:03.581198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f7d72-27d0-4b99-9c0e-e2aafe68fa7b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:03.582764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f7d72-27d0-4b99-9c0e-e2aafe68fa7b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-295f7d72-27d0-4b99-9c0e-e2aafe68fa7b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:35:03.597560 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:03.598605 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:03.599585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:03.599585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:03.599585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:35:03.599585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:35:03.599585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:35:03.599585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:35:03.599585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:35:03.599585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:35:03.599585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 09:35:03.599585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:03.599585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 624/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:35:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:03.604780 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807aaee-eb03-486e-b80a-be8eab7c585a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:03.662296 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:03.720001 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807aaee-eb03-486e-b80a-be8eab7c585a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:03.757598 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdf555-7be8-4a28-9f05-43d3fa955bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:03.758267 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdf555-7be8-4a28-9f05-43d3fa955bcb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:03.758582 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdf555-7be8-4a28-9f05-43d3fa955bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:03.758862 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdf555-7be8-4a28-9f05-43d3fa955bcb None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:03.759701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdf555-7be8-4a28-9f05-43d3fa955bcb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:03.760012 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdf555-7be8-4a28-9f05-43d3fa955bcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:03.761437 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdf555-7be8-4a28-9f05-43d3fa955bcb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:03.781209 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 603/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Jun 15 09:35:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:03.785091 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f7d72-27d0-4b99-9c0e-e2aafe68fa7b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:03.898566 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f7d72-27d0-4b99-9c0e-e2aafe68fa7b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:03.935349 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febc51c-ff94-4fa9-a043-02fbd2a97bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:03.936060 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febc51c-ff94-4fa9-a043-02fbd2a97bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:03.936350 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febc51c-ff94-4fa9-a043-02fbd2a97bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:03.936629 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febc51c-ff94-4fa9-a043-02fbd2a97bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:03.947387 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febc51c-ff94-4fa9-a043-02fbd2a97bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:03.948820 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febc51c-ff94-4fa9-a043-02fbd2a97bc8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:03.967454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0febc51c-ff94-4fa9-a043-02fbd2a97bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:03.967454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:03.967454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:03.967454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:03.967454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:03.967454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:03.967454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:03.967454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:03.967454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:03.967454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:03.967454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:03.967454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:03.967454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:35:03.967454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:35:03.967454 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:03.968712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:03.970236 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:35:03.970236 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:35:03.970236 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:03.970236 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:03.970236 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 625/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:35:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:03.975408 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdf555-7be8-4a28-9f05-43d3fa955bcb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:04.079690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdf555-7be8-4a28-9f05-43d3fa955bcb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:04.082021 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:04.118198 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a422786-3ecf-49ad-865a-9f87bb476813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:04.118912 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a422786-3ecf-49ad-865a-9f87bb476813 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:04.119213 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a422786-3ecf-49ad-865a-9f87bb476813 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:04.119477 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a422786-3ecf-49ad-865a-9f87bb476813 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:04.120526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a422786-3ecf-49ad-865a-9f87bb476813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:04.120766 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a422786-3ecf-49ad-865a-9f87bb476813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:04.122135 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a422786-3ecf-49ad-865a-9f87bb476813 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:04.134078 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 604/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:04.140844 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febc51c-ff94-4fa9-a043-02fbd2a97bc8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:04.154080 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:04.254761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febc51c-ff94-4fa9-a043-02fbd2a97bc8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:04.291287 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203c7b-4a6b-424d-8e1e-ef1ffb6ac5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:04.292118 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203c7b-4a6b-424d-8e1e-ef1ffb6ac5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:04.292439 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203c7b-4a6b-424d-8e1e-ef1ffb6ac5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:04.292723 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203c7b-4a6b-424d-8e1e-ef1ffb6ac5e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:04.300026 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f203c7b-4a6b-424d-8e1e-ef1ffb6ac5e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:04.301464 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f203c7b-4a6b-424d-8e1e-ef1ffb6ac5e1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:04.316673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9f203c7b-4a6b-424d-8e1e-ef1ffb6ac5e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:35:04.316673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:04.316673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:04.316673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:04.316673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:04.316673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:04.316673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:04.316673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:04.316673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:04.316673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:04.316673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:04.316673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:04.316673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:35:04.316673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:35:04.316673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:04.317846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:04.319233 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:35:04.319233 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:35:04.319233 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:35:04.319233 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:35:04.319233 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:35:04.319233 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:35:04.319233 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:35:04.319233 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:04.319233 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 626/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:35:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:04.324034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a422786-3ecf-49ad-865a-9f87bb476813 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:04.429717 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a422786-3ecf-49ad-865a-9f87bb476813 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:04.466659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced6121-d622-4166-a783-389e9afc2b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:04.467328 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced6121-d622-4166-a783-389e9afc2b7a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:04.467622 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced6121-d622-4166-a783-389e9afc2b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:04.467900 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced6121-d622-4166-a783-389e9afc2b7a None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:04.468688 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced6121-d622-4166-a783-389e9afc2b7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:04.468998 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced6121-d622-4166-a783-389e9afc2b7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:04.471010 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced6121-d622-4166-a783-389e9afc2b7a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:04.483988 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 605/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:35:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:35:04.489973 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203c7b-4a6b-424d-8e1e-ef1ffb6ac5e1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:04.565262 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:04.602703 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203c7b-4a6b-424d-8e1e-ef1ffb6ac5e1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:04.638930 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e228cf1-43b9-446d-98ab-210d7811afe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:04.639820 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e228cf1-43b9-446d-98ab-210d7811afe6 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:04.640116 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e228cf1-43b9-446d-98ab-210d7811afe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:04.640381 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e228cf1-43b9-446d-98ab-210d7811afe6 None admin] PATH_INFO: `/v3/projects/b978d75b349941f5bedbe56544f41ada/users/ebadf82546c5464ab21a467a50c70513/roles/0ff0d3dcb5e448c3abc2470461490795` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:04.656200 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e228cf1-43b9-446d-98ab-210d7811afe6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b978d75b349941f5bedbe56544f41ada, user_id=ebadf82546c5464ab21a467a50c70513, role_id=0ff0d3dcb5e448c3abc2470461490795)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:04.657656 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e228cf1-43b9-446d-98ab-210d7811afe6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:04.670371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 627/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:35:04 2022] PUT /identity/v3/projects/b978d75b349941f5bedbe56544f41ada/users/ebadf82546c5464ab21a467a50c70513/roles/0ff0d3dcb5e448c3abc2470461490795 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:35:06.984014 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eae8f6-3b1a-43fe-a041-25ae7181e69b None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:06.985382 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eae8f6-3b1a-43fe-a041-25ae7181e69b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:06.985382 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eae8f6-3b1a-43fe-a041-25ae7181e69b None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:06.986527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 606/1233] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:35:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:35:06.993527 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213e916-9960-4982-b060-3f0bd18414ba None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:06.994392 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213e916-9960-4982-b060-3f0bd18414ba None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:06.994623 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213e916-9960-4982-b060-3f0bd18414ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:07.022085 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5213e916-9960-4982-b060-3f0bd18414ba None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:35:07.024280 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5213e916-9960-4982-b060-3f0bd18414ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:35:07.106579 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 628/1234] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:35:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:35:07.132909 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eae8f6-3b1a-43fe-a041-25ae7181e69b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:07.172956 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:07.304545 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eae8f6-3b1a-43fe-a041-25ae7181e69b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:07.349908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552d51d-06b7-4a4d-b05c-ba6db9a336fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:07.350709 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d51d-06b7-4a4d-b05c-ba6db9a336fe None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:07.350997 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d51d-06b7-4a4d-b05c-ba6db9a336fe None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:07.351277 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d51d-06b7-4a4d-b05c-ba6db9a336fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:07.363264 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552d51d-06b7-4a4d-b05c-ba6db9a336fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7552d51d-06b7-4a4d-b05c-ba6db9a336fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:35:07.371498 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:07.373361 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:07.375024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:07.375024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:07.375024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:07.375024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:07.375024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:35:07.375024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:35:07.375024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:35:07.375024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:35:07.375024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:35:07.375024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:35:07.375024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 09:35:07.375024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:35:07.375024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 607/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Wed Jun 15 09:35:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:07.380964 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213e916-9960-4982-b060-3f0bd18414ba None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:07.442293 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:07.520591 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213e916-9960-4982-b060-3f0bd18414ba None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:07.574410 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0964b6-1b93-4b77-b6af-9f6b71f2e49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:07.575030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0964b6-1b93-4b77-b6af-9f6b71f2e49a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:07.575318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0964b6-1b93-4b77-b6af-9f6b71f2e49a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:07.575596 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0964b6-1b93-4b77-b6af-9f6b71f2e49a None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:07.576362 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0964b6-1b93-4b77-b6af-9f6b71f2e49a None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:07.576674 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0964b6-1b93-4b77-b6af-9f6b71f2e49a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:07.578608 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0964b6-1b93-4b77-b6af-9f6b71f2e49a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:07.590668 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 629/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Wed Jun 15 09:35:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:07.597894 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552d51d-06b7-4a4d-b05c-ba6db9a336fe None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:07.722989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:07.751548 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552d51d-06b7-4a4d-b05c-ba6db9a336fe None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:07.801149 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c349019-09c4-487c-b67b-c1cac543a7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:07.801977 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c349019-09c4-487c-b67b-c1cac543a7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:07.802266 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c349019-09c4-487c-b67b-c1cac543a7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:07.802578 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c349019-09c4-487c-b67b-c1cac543a7e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:07.816197 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c349019-09c4-487c-b67b-c1cac543a7e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:07.818963 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c349019-09c4-487c-b67b-c1cac543a7e6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:07.848817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-0c349019-09c4-487c-b67b-c1cac543a7e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:07.848817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:07.848817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:07.848817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:07.848817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:07.848817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:07.848817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:07.848817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:07.848817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:07.848817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:07.848817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:07.848817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:07.848817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:35:07.848817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:35:07.848817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:07.850526 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:07.852384 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:35:07.852384 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:35:07.852384 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:07.852384 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:35:07.852384 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 608/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:35:07.858394 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0964b6-1b93-4b77-b6af-9f6b71f2e49a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:08.019496 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0964b6-1b93-4b77-b6af-9f6b71f2e49a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:08.039811 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:08.076690 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f9155-d31d-4a08-af11-77f5b4896776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:08.077374 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f9155-d31d-4a08-af11-77f5b4896776 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:08.077662 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f9155-d31d-4a08-af11-77f5b4896776 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:08.077945 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f9155-d31d-4a08-af11-77f5b4896776 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:08.079216 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f9155-d31d-4a08-af11-77f5b4896776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:08.079530 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f9155-d31d-4a08-af11-77f5b4896776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:08.081009 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f9155-d31d-4a08-af11-77f5b4896776 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:08.094485 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 630/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:08.105033 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c349019-09c4-487c-b67b-c1cac543a7e6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:08.272215 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c349019-09c4-487c-b67b-c1cac543a7e6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:08.325110 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e69e8b-4d54-476f-969e-40e48cabe220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:08.327154 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e69e8b-4d54-476f-969e-40e48cabe220 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:08.327616 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e69e8b-4d54-476f-969e-40e48cabe220 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:08.328589 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e69e8b-4d54-476f-969e-40e48cabe220 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:08.332374 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:08.340114 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e69e8b-4d54-476f-969e-40e48cabe220 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:08.342796 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e69e8b-4d54-476f-969e-40e48cabe220 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-44e69e8b-4d54-476f-969e-40e48cabe220 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:35:08.364370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:08.366656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:08.368048 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:08.368048 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:08.368048 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:35:08.368048 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:35:08.368048 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:35:08.368048 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:35:08.368048 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:35:08.368048 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:35:08.368048 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 09:35:08.368048 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:35:08.368048 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 609/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:35:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:08.374083 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f9155-d31d-4a08-af11-77f5b4896776 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:08.528141 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f9155-d31d-4a08-af11-77f5b4896776 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:08.584182 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e8caf-9e86-4d1a-b87e-d88c06a37847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:08.585711 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e8caf-9e86-4d1a-b87e-d88c06a37847 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:08.586466 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e8caf-9e86-4d1a-b87e-d88c06a37847 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:08.587186 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e8caf-9e86-4d1a-b87e-d88c06a37847 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:08.589037 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e8caf-9e86-4d1a-b87e-d88c06a37847 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:08.589817 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e8caf-9e86-4d1a-b87e-d88c06a37847 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:08.593139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e8caf-9e86-4d1a-b87e-d88c06a37847 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:08.630641 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 631/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Jun 15 09:35:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:08.636935 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e69e8b-4d54-476f-969e-40e48cabe220 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:08.797826 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e69e8b-4d54-476f-969e-40e48cabe220 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:08.854820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c38664-7ad7-48d2-849c-7e8dd8b6f314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:08.856024 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c38664-7ad7-48d2-849c-7e8dd8b6f314 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:08.856607 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c38664-7ad7-48d2-849c-7e8dd8b6f314 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:08.857144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c38664-7ad7-48d2-849c-7e8dd8b6f314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:08.985666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:08.999659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c38664-7ad7-48d2-849c-7e8dd8b6f314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:09.003144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c38664-7ad7-48d2-849c-7e8dd8b6f314 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:09.187032 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 610/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:35:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 09:35:09.196443 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e8caf-9e86-4d1a-b87e-d88c06a37847 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:09.240223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:09.345225 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e8caf-9e86-4d1a-b87e-d88c06a37847 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:09.395930 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6024e2e-2ca9-4cfb-855d-30be0906fccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:09.397065 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6024e2e-2ca9-4cfb-855d-30be0906fccf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:09.397447 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6024e2e-2ca9-4cfb-855d-30be0906fccf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:09.397870 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6024e2e-2ca9-4cfb-855d-30be0906fccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:09.413866 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6024e2e-2ca9-4cfb-855d-30be0906fccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:09.416045 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6024e2e-2ca9-4cfb-855d-30be0906fccf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:09.441983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a6024e2e-2ca9-4cfb-855d-30be0906fccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:09.441983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:09.441983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:09.441983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:09.441983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:09.441983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:09.441983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:09.441983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:09.441983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:09.441983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:09.441983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:09.441983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:09.441983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:35:09.441983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:35:09.441983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:09.444175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:09.445972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:35:09.445972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:35:09.445972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:09.445972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:09.445972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 632/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:35:09.452578 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c38664-7ad7-48d2-849c-7e8dd8b6f314 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:09.588509 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:09.597418 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c38664-7ad7-48d2-849c-7e8dd8b6f314 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:09.644641 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad3864-9a97-4f22-9c80-82f026dc04df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:09.645424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad3864-9a97-4f22-9c80-82f026dc04df None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:09.645717 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad3864-9a97-4f22-9c80-82f026dc04df None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:09.645998 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad3864-9a97-4f22-9c80-82f026dc04df None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:09.646805 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad3864-9a97-4f22-9c80-82f026dc04df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:09.647116 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad3864-9a97-4f22-9c80-82f026dc04df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:09.648635 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad3864-9a97-4f22-9c80-82f026dc04df None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:09.663708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 611/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:09.670762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6024e2e-2ca9-4cfb-855d-30be0906fccf None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:09.792548 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:09.819892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6024e2e-2ca9-4cfb-855d-30be0906fccf None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:09.867115 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd3cc6-60d9-4b34-9258-4509ac42bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:09.868441 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd3cc6-60d9-4b34-9258-4509ac42bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:09.868727 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd3cc6-60d9-4b34-9258-4509ac42bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:09.869011 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd3cc6-60d9-4b34-9258-4509ac42bdc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:09.883126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd3cc6-60d9-4b34-9258-4509ac42bdc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:09.886433 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd3cc6-60d9-4b34-9258-4509ac42bdc7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:09.907107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f2bd3cc6-60d9-4b34-9258-4509ac42bdc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:35:09.907107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:09.907107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:09.907107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:09.907107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:09.907107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:09.907107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:09.907107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:09.907107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:09.907107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:09.907107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:09.907107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:09.907107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:35:09.907107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:35:09.907107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:09.916265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:09.918244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:35:09.918244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:35:09.918244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:35:09.918244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:35:09.918244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:35:09.918244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:35:09.918244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:35:09.918244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:09.918244 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 633/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:35:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:09.919386 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad3864-9a97-4f22-9c80-82f026dc04df None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:10.063859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad3864-9a97-4f22-9c80-82f026dc04df None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:10.111027 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1907b-f85c-4698-9d66-b7079ee7df9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:10.111938 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1907b-f85c-4698-9d66-b7079ee7df9c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:10.112451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1907b-f85c-4698-9d66-b7079ee7df9c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:10.112934 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1907b-f85c-4698-9d66-b7079ee7df9c None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:10.114383 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1907b-f85c-4698-9d66-b7079ee7df9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:10.114941 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1907b-f85c-4698-9d66-b7079ee7df9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:10.117626 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1907b-f85c-4698-9d66-b7079ee7df9c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:10.141671 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 612/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:35:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:10.150381 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd3cc6-60d9-4b34-9258-4509ac42bdc7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:10.312064 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd3cc6-60d9-4b34-9258-4509ac42bdc7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:10.356107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3a8b5-bd6a-4052-a8b6-e8bd87825413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:10.357075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3a8b5-bd6a-4052-a8b6-e8bd87825413 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:10.357489 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3a8b5-bd6a-4052-a8b6-e8bd87825413 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:10.357947 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3a8b5-bd6a-4052-a8b6-e8bd87825413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:10.359656 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3a8b5-bd6a-4052-a8b6-e8bd87825413 None admin] RBAC: Adding query filter params (role.id=0ff0d3dcb5e448c3abc2470461490795, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=ebadf82546c5464ab21a467a50c70513) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:10.360024 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3a8b5-bd6a-4052-a8b6-e8bd87825413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:10.361849 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3a8b5-bd6a-4052-a8b6-e8bd87825413 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:10.369256 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 634/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:35:10 2022] GET /identity/v3/role_assignments?user.id=ebadf82546c5464ab21a467a50c70513&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=0ff0d3dcb5e448c3abc2470461490795 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:12.774203 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4e216-ee25-487c-b1c3-65c7dc277d31 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:12.775299 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4e216-ee25-487c-b1c3-65c7dc277d31 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:12.775299 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4e216-ee25-487c-b1c3-65c7dc277d31 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:12.776597 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 613/1247] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:35:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:35:12.784087 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd098e-19f8-4283-a2e7-54ff03cd6d8f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:12.784614 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd098e-19f8-4283-a2e7-54ff03cd6d8f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:12.785061 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd098e-19f8-4283-a2e7-54ff03cd6d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:12.794094 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:12.815534 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-83fd098e-19f8-4283-a2e7-54ff03cd6d8f None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:35:12.817259 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-83fd098e-19f8-4283-a2e7-54ff03cd6d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:35:12.903767 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 635/1248] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:35:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:35:12.932837 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4e216-ee25-487c-b1c3-65c7dc277d31 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:12.962409 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:13.084641 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4e216-ee25-487c-b1c3-65c7dc277d31 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:13.129208 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df5853-d56c-4a18-a969-77af71ad3951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:13.130341 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df5853-d56c-4a18-a969-77af71ad3951 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:13.130766 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df5853-d56c-4a18-a969-77af71ad3951 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:13.131149 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df5853-d56c-4a18-a969-77af71ad3951 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:13.150112 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df5853-d56c-4a18-a969-77af71ad3951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-53df5853-d56c-4a18-a969-77af71ad3951 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:35:13.161354 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:13.163352 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:13.164605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:13.164605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:13.164605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:13.164605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:13.164605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:35:13.164605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:35:13.164605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:35:13.164605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:35:13.164605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:35:13.164605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:35:13.164605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:35:13.164605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:35:13.164605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 614/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:35:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:13.171856 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd098e-19f8-4283-a2e7-54ff03cd6d8f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:13.328281 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd098e-19f8-4283-a2e7-54ff03cd6d8f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:13.366889 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:13.373474 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df767c-4526-478d-8cf2-b1248f10ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:13.374196 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df767c-4526-478d-8cf2-b1248f10ed4a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:13.375030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df767c-4526-478d-8cf2-b1248f10ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:13.375312 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df767c-4526-478d-8cf2-b1248f10ed4a None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:13.376085 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df767c-4526-478d-8cf2-b1248f10ed4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:13.376403 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df767c-4526-478d-8cf2-b1248f10ed4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:13.377958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df767c-4526-478d-8cf2-b1248f10ed4a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:13.388916 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 636/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:35:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:13.396618 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df5853-d56c-4a18-a969-77af71ad3951 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:13.527173 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:13.575063 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df5853-d56c-4a18-a969-77af71ad3951 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:13.641210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf486a9c-cb90-4169-92d3-fccede273357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:13.642111 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf486a9c-cb90-4169-92d3-fccede273357 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:13.642419 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf486a9c-cb90-4169-92d3-fccede273357 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:13.642770 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf486a9c-cb90-4169-92d3-fccede273357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:13.656247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf486a9c-cb90-4169-92d3-fccede273357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:13.657798 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf486a9c-cb90-4169-92d3-fccede273357 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:13.677629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-bf486a9c-cb90-4169-92d3-fccede273357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:13.677629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:13.677629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:13.677629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:13.677629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:13.677629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:13.677629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:13.677629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:13.677629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:13.677629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:13.677629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:13.677629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:13.677629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:35:13.677629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:35:13.677629 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:13.686999 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:13.688134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:35:13.688134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:35:13.688134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:13.688134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:35:13.688134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 615/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:13.688437 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df767c-4526-478d-8cf2-b1248f10ed4a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:13.864306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df767c-4526-478d-8cf2-b1248f10ed4a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:13.927460 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c2b83-59f4-4fe9-800c-e067bd6301bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:13.928325 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c2b83-59f4-4fe9-800c-e067bd6301bf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:13.928713 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c2b83-59f4-4fe9-800c-e067bd6301bf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:13.929128 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c2b83-59f4-4fe9-800c-e067bd6301bf None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:13.930096 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c2b83-59f4-4fe9-800c-e067bd6301bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:13.930578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c2b83-59f4-4fe9-800c-e067bd6301bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:13.932082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c2b83-59f4-4fe9-800c-e067bd6301bf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:13.946976 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 637/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:13.955769 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf486a9c-cb90-4169-92d3-fccede273357 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:14.090258 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf486a9c-cb90-4169-92d3-fccede273357 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:14.130103 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:14.142254 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050811b8-f51e-4373-82c4-4641eb6e8798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:14.143277 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050811b8-f51e-4373-82c4-4641eb6e8798 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:14.143701 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050811b8-f51e-4373-82c4-4641eb6e8798 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:14.144003 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050811b8-f51e-4373-82c4-4641eb6e8798 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:14.162592 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050811b8-f51e-4373-82c4-4641eb6e8798 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:14.164587 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050811b8-f51e-4373-82c4-4641eb6e8798 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-050811b8-f51e-4373-82c4-4641eb6e8798 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:35:14.184391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:14.186412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:14.188932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:14.188932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:14.188932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:35:14.188932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:35:14.188932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:35:14.188932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:35:14.188932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:35:14.188932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:35:14.188932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 09:35:14.188932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:35:14.188932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 616/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:35:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:14.196186 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c2b83-59f4-4fe9-800c-e067bd6301bf None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:14.287881 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:14.346995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c2b83-59f4-4fe9-800c-e067bd6301bf None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:14.390138 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382015d9-1e97-4878-a0e3-45ec95080076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:14.390836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382015d9-1e97-4878-a0e3-45ec95080076 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:14.391124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382015d9-1e97-4878-a0e3-45ec95080076 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:14.391404 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382015d9-1e97-4878-a0e3-45ec95080076 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:14.392265 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382015d9-1e97-4878-a0e3-45ec95080076 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:14.392577 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382015d9-1e97-4878-a0e3-45ec95080076 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:14.394036 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382015d9-1e97-4878-a0e3-45ec95080076 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:14.417705 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 638/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Jun 15 09:35:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:14.425224 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050811b8-f51e-4373-82c4-4641eb6e8798 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:14.581516 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050811b8-f51e-4373-82c4-4641eb6e8798 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:14.636602 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94593308-b082-4abc-9781-f161273271cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:14.637745 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94593308-b082-4abc-9781-f161273271cb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:14.638221 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94593308-b082-4abc-9781-f161273271cb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:14.639399 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94593308-b082-4abc-9781-f161273271cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:14.727040 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:14.753163 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94593308-b082-4abc-9781-f161273271cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:14.755254 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94593308-b082-4abc-9781-f161273271cb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:14.906591 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 617/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:35:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:35:14.913187 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382015d9-1e97-4878-a0e3-45ec95080076 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:15.042170 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382015d9-1e97-4878-a0e3-45ec95080076 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:15.059181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:15.089562 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7d8dd-8ac3-4510-8f17-80403fa5c76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:15.090561 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7d8dd-8ac3-4510-8f17-80403fa5c76e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:15.090981 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7d8dd-8ac3-4510-8f17-80403fa5c76e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:15.091393 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7d8dd-8ac3-4510-8f17-80403fa5c76e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:15.108478 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7d8dd-8ac3-4510-8f17-80403fa5c76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:15.110705 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7d8dd-8ac3-4510-8f17-80403fa5c76e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:15.133835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-81c7d8dd-8ac3-4510-8f17-80403fa5c76e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:15.133835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:15.133835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:15.133835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:15.133835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:15.133835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:15.133835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:15.133835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:15.133835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:15.133835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:15.133835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:15.133835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:15.133835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:35:15.133835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:35:15.133835 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:15.135373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:15.136608 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:35:15.136608 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:35:15.136608 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:15.136608 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:15.136608 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 639/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:15.144230 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94593308-b082-4abc-9781-f161273271cb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:15.288314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:15.309067 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94593308-b082-4abc-9781-f161273271cb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:15.370643 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214737a-bb3d-454c-bd07-6de808c8acd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:15.371768 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214737a-bb3d-454c-bd07-6de808c8acd6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:15.372237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214737a-bb3d-454c-bd07-6de808c8acd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:15.372777 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214737a-bb3d-454c-bd07-6de808c8acd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:15.374454 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214737a-bb3d-454c-bd07-6de808c8acd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:15.375181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214737a-bb3d-454c-bd07-6de808c8acd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:15.377614 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214737a-bb3d-454c-bd07-6de808c8acd6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:15.396308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 618/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:15.403930 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7d8dd-8ac3-4510-8f17-80403fa5c76e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:15.577355 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7d8dd-8ac3-4510-8f17-80403fa5c76e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:15.639486 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76702918-ecc5-4f80-bf09-d52c6bfc5d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:15.640400 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76702918-ecc5-4f80-bf09-d52c6bfc5d1c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:15.640707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76702918-ecc5-4f80-bf09-d52c6bfc5d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:15.640985 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76702918-ecc5-4f80-bf09-d52c6bfc5d1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:15.652071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76702918-ecc5-4f80-bf09-d52c6bfc5d1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:15.654197 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76702918-ecc5-4f80-bf09-d52c6bfc5d1c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:15.675112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-76702918-ecc5-4f80-bf09-d52c6bfc5d1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:35:15.675112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:15.675112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:15.675112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:15.675112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:15.675112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:15.675112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:15.675112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:15.675112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:15.675112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:15.675112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:15.675112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:15.675112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:35:15.675112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:35:15.675112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:15.676923 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:15.678828 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:35:15.678828 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:35:15.678828 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:35:15.678828 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:35:15.678828 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:35:15.678828 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:35:15.678828 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:35:15.678828 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:15.678828 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 640/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:35:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:15.684417 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214737a-bb3d-454c-bd07-6de808c8acd6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:15.831972 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214737a-bb3d-454c-bd07-6de808c8acd6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:15.874983 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca427c-8178-4f92-bca6-1bc985164b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:15.875713 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca427c-8178-4f92-bca6-1bc985164b1f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:15.876060 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca427c-8178-4f92-bca6-1bc985164b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:15.876398 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca427c-8178-4f92-bca6-1bc985164b1f None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:15.877281 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca427c-8178-4f92-bca6-1bc985164b1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:15.877656 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca427c-8178-4f92-bca6-1bc985164b1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:15.879395 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca427c-8178-4f92-bca6-1bc985164b1f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:15.894023 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 619/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:35:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:15.903365 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76702918-ecc5-4f80-bf09-d52c6bfc5d1c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:15.948169 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:16.043683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76702918-ecc5-4f80-bf09-d52c6bfc5d1c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:16.081082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c58150-1491-4aad-823b-41b00159861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:16.081758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c58150-1491-4aad-823b-41b00159861e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:16.082106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c58150-1491-4aad-823b-41b00159861e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:16.082318 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c58150-1491-4aad-823b-41b00159861e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:16.083212 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c58150-1491-4aad-823b-41b00159861e None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=ebadf82546c5464ab21a467a50c70513) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:16.083523 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c58150-1491-4aad-823b-41b00159861e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:16.084992 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c58150-1491-4aad-823b-41b00159861e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:16.092119 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 641/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:35:15 2022] GET /identity/v3/role_assignments?user.id=ebadf82546c5464ab21a467a50c70513&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:18.320627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82121b-9855-4534-b06a-219584b5fa48 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:18.321234 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82121b-9855-4534-b06a-219584b5fa48 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:18.321439 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82121b-9855-4534-b06a-219584b5fa48 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:18.323500 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 620/1261] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:35:18.330047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378de7a-e19e-46b6-b8e8-9e356b1ad161 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:18.330881 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378de7a-e19e-46b6-b8e8-9e356b1ad161 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:18.330881 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378de7a-e19e-46b6-b8e8-9e356b1ad161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:18.349202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8378de7a-e19e-46b6-b8e8-9e356b1ad161 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:35:18.350570 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8378de7a-e19e-46b6-b8e8-9e356b1ad161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:35:18.434658 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 642/1262] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:35:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:35:18.458752 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82121b-9855-4534-b06a-219584b5fa48 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:18.470296 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:18.576400 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82121b-9855-4534-b06a-219584b5fa48 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:18.615452 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ac28c-dbb2-41a7-a7d3-8dc44bf18f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:18.616258 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ac28c-dbb2-41a7-a7d3-8dc44bf18f97 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:18.616542 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ac28c-dbb2-41a7-a7d3-8dc44bf18f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:18.616819 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ac28c-dbb2-41a7-a7d3-8dc44bf18f97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:18.628483 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ac28c-dbb2-41a7-a7d3-8dc44bf18f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-390ac28c-dbb2-41a7-a7d3-8dc44bf18f97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:35:18.636549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:18.638237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:18.639252 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:18.639252 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:18.639252 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:18.639252 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:18.639252 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:35:18.639252 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:35:18.639252 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:35:18.639252 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:35:18.639252 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:35:18.639252 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:35:18.639252 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:35:18.639252 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:35:18.639252 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 621/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:35:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:18.644689 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378de7a-e19e-46b6-b8e8-9e356b1ad161 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:18.663826 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:18.756098 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378de7a-e19e-46b6-b8e8-9e356b1ad161 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:18.794697 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e736-dc1f-48cf-835f-eecf4d6fe49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:18.795877 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e736-dc1f-48cf-835f-eecf4d6fe49c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:18.796182 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e736-dc1f-48cf-835f-eecf4d6fe49c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:18.796462 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4e736-dc1f-48cf-835f-eecf4d6fe49c None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:18.797349 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4e736-dc1f-48cf-835f-eecf4d6fe49c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:18.797633 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4e736-dc1f-48cf-835f-eecf4d6fe49c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:18.799218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4e736-dc1f-48cf-835f-eecf4d6fe49c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:18.809516 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 643/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:35:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:18.817225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ac28c-dbb2-41a7-a7d3-8dc44bf18f97 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:18.902759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:18.940611 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ac28c-dbb2-41a7-a7d3-8dc44bf18f97 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:18.979895 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9d118-9c75-451a-91ea-18427802feb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:18.980832 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9d118-9c75-451a-91ea-18427802feb6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:18.981122 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9d118-9c75-451a-91ea-18427802feb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:18.981424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9d118-9c75-451a-91ea-18427802feb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:18.995240 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9d118-9c75-451a-91ea-18427802feb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:18.996836 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9d118-9c75-451a-91ea-18427802feb6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:19.015165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-24c9d118-9c75-451a-91ea-18427802feb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:19.015165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:19.015165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:19.015165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:19.015165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:19.015165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:19.015165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:19.015165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:19.015165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:19.015165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:19.015165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:19.015165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:19.015165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:35:19.015165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:35:19.015165 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:19.016902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:19.018764 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:35:19.018764 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:35:19.018764 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:19.018764 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:35:19.018764 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 622/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:19.023058 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e736-dc1f-48cf-835f-eecf4d6fe49c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:19.157595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:19.190069 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4e736-dc1f-48cf-835f-eecf4d6fe49c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:19.239509 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4366c04-456a-4c4d-9c88-dac748465a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:19.240389 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366c04-456a-4c4d-9c88-dac748465a82 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:19.240821 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366c04-456a-4c4d-9c88-dac748465a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:19.241291 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366c04-456a-4c4d-9c88-dac748465a82 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:19.242142 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4366c04-456a-4c4d-9c88-dac748465a82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:19.242653 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4366c04-456a-4c4d-9c88-dac748465a82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:19.244595 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4366c04-456a-4c4d-9c88-dac748465a82 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:19.258771 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 644/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:19.265595 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9d118-9c75-451a-91ea-18427802feb6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:19.382879 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9d118-9c75-451a-91ea-18427802feb6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:19.405890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:19.421485 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9069a39-7ae3-4822-a87e-526d2c849000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:19.422249 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9069a39-7ae3-4822-a87e-526d2c849000 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:19.422567 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9069a39-7ae3-4822-a87e-526d2c849000 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:19.422852 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9069a39-7ae3-4822-a87e-526d2c849000 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:19.431368 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9069a39-7ae3-4822-a87e-526d2c849000 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:19.432898 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9069a39-7ae3-4822-a87e-526d2c849000 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-e9069a39-7ae3-4822-a87e-526d2c849000 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:35:19.448080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:19.449298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:19.450570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:19.450570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:19.450570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:35:19.450570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:35:19.450570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:35:19.450570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:35:19.450570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:35:19.450570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:35:19.450570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 09:35:19.450570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:35:19.450570 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 623/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:35:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:19.456670 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4366c04-456a-4c4d-9c88-dac748465a82 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:19.571246 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4366c04-456a-4c4d-9c88-dac748465a82 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:19.608275 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b4959-93c2-473b-bedf-0b6ac99f840d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:19.609084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b4959-93c2-473b-bedf-0b6ac99f840d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:19.609376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b4959-93c2-473b-bedf-0b6ac99f840d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:19.609660 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b4959-93c2-473b-bedf-0b6ac99f840d None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:19.610687 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b4959-93c2-473b-bedf-0b6ac99f840d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:19.611075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b4959-93c2-473b-bedf-0b6ac99f840d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:19.612594 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b4959-93c2-473b-bedf-0b6ac99f840d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:19.623062 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:19.633390 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 645/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Jun 15 09:35:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:35:19.639675 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9069a39-7ae3-4822-a87e-526d2c849000 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:19.750504 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9069a39-7ae3-4822-a87e-526d2c849000 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:19.789738 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0131a-950b-467c-b87e-df1912213a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:19.790565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0131a-950b-467c-b87e-df1912213a27 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:19.790858 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0131a-950b-467c-b87e-df1912213a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:19.791208 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0131a-950b-467c-b87e-df1912213a27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:19.803175 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0131a-950b-467c-b87e-df1912213a27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:19.804645 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0131a-950b-467c-b87e-df1912213a27 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:19.831246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-04c0131a-950b-467c-b87e-df1912213a27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:19.831246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:19.831246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:19.831246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:19.831246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:19.831246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:19.831246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:19.831246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:19.831246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:19.831246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:19.831246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:19.831246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:19.831246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:35:19.831246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:35:19.831246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:19.832391 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:19.833313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:35:19.833313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:35:19.833313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:19.833313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:35:19.833313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 624/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:19.838738 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b4959-93c2-473b-bedf-0b6ac99f840d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:19.946410 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b4959-93c2-473b-bedf-0b6ac99f840d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:19.986785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29311c91-51e7-4ddb-a04b-ed7c1e666f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:19.987459 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29311c91-51e7-4ddb-a04b-ed7c1e666f73 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:19.987742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29311c91-51e7-4ddb-a04b-ed7c1e666f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:19.988017 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29311c91-51e7-4ddb-a04b-ed7c1e666f73 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:19.988742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29311c91-51e7-4ddb-a04b-ed7c1e666f73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:19.989049 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29311c91-51e7-4ddb-a04b-ed7c1e666f73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:19.990416 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29311c91-51e7-4ddb-a04b-ed7c1e666f73 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:20.003676 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 646/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:20.009308 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0131a-950b-467c-b87e-df1912213a27 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:20.041282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:20.112413 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0131a-950b-467c-b87e-df1912213a27 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:20.155051 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1487c0-3aa0-4cf4-a2e9-316680df84e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:20.156521 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1487c0-3aa0-4cf4-a2e9-316680df84e2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:20.156945 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1487c0-3aa0-4cf4-a2e9-316680df84e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:20.157560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1487c0-3aa0-4cf4-a2e9-316680df84e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:20.168520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1487c0-3aa0-4cf4-a2e9-316680df84e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:20.170900 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1487c0-3aa0-4cf4-a2e9-316680df84e2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:20.186711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ce1487c0-3aa0-4cf4-a2e9-316680df84e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:35:20.186711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:20.186711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:20.186711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:20.186711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:20.186711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:20.186711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:20.186711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:20.186711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:20.186711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:20.186711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:20.186711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:20.186711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:35:20.186711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:35:20.186711 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:20.188434 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:20.189904 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:35:20.189904 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:35:20.189904 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:35:20.189904 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:35:20.189904 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:35:20.189904 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:35:20.189904 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:35:20.189904 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:35:20.193015 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 625/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:35:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:20.194435 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29311c91-51e7-4ddb-a04b-ed7c1e666f73 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:20.264536 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:20.325716 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29311c91-51e7-4ddb-a04b-ed7c1e666f73 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:20.365290 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42529db0-3d2b-456e-be61-d728ffe1905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:20.365954 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42529db0-3d2b-456e-be61-d728ffe1905f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:20.366243 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42529db0-3d2b-456e-be61-d728ffe1905f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:20.366550 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42529db0-3d2b-456e-be61-d728ffe1905f None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:20.367339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42529db0-3d2b-456e-be61-d728ffe1905f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:20.367652 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42529db0-3d2b-456e-be61-d728ffe1905f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:20.369336 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42529db0-3d2b-456e-be61-d728ffe1905f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:20.381552 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 647/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:35:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:20.387592 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1487c0-3aa0-4cf4-a2e9-316680df84e2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:20.489583 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:20.501279 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1487c0-3aa0-4cf4-a2e9-316680df84e2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:20.541406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83a3e5-6b44-4fc1-888a-366ac817ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:20.542229 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83a3e5-6b44-4fc1-888a-366ac817ecd7 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:20.542536 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83a3e5-6b44-4fc1-888a-366ac817ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:20.542821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83a3e5-6b44-4fc1-888a-366ac817ecd7 None admin] PATH_INFO: `/v3/projects/b978d75b349941f5bedbe56544f41ada/users/ebadf82546c5464ab21a467a50c70513/roles/efaf387c51e14931820f2a9b33ac5175` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:20.544823 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83a3e5-6b44-4fc1-888a-366ac817ecd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b978d75b349941f5bedbe56544f41ada, user_id=ebadf82546c5464ab21a467a50c70513, role_id=efaf387c51e14931820f2a9b33ac5175)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:20.546978 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c83a3e5-6b44-4fc1-888a-366ac817ecd7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:20.560029 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 626/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Wed Jun 15 09:35:20 2022] PUT /identity/v3/projects/b978d75b349941f5bedbe56544f41ada/users/ebadf82546c5464ab21a467a50c70513/roles/efaf387c51e14931820f2a9b33ac5175 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:35:22.709442 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101740e-b618-4e9a-93d0-61d6a1e645dd None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:22.709972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101740e-b618-4e9a-93d0-61d6a1e645dd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:22.709972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101740e-b618-4e9a-93d0-61d6a1e645dd None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:22.711408 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 648/1274] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:35:22.718104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fb704-4ca3-4273-8d6e-85eeac3b040c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:22.718646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fb704-4ca3-4273-8d6e-85eeac3b040c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:22.719157 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fb704-4ca3-4273-8d6e-85eeac3b040c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:22.740049 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b06fb704-4ca3-4273-8d6e-85eeac3b040c None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:35:22.741813 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b06fb704-4ca3-4273-8d6e-85eeac3b040c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:35:22.816040 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 627/1275] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:35:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:35:22.842340 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101740e-b618-4e9a-93d0-61d6a1e645dd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:22.952165 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101740e-b618-4e9a-93d0-61d6a1e645dd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:22.971962 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:22.990810 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202057f-8e42-4a87-b8a2-15c66c5018c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:22.991648 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202057f-8e42-4a87-b8a2-15c66c5018c1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:22.991930 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202057f-8e42-4a87-b8a2-15c66c5018c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:22.992205 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202057f-8e42-4a87-b8a2-15c66c5018c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:23.003639 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202057f-8e42-4a87-b8a2-15c66c5018c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d202057f-8e42-4a87-b8a2-15c66c5018c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 09:35:23.012021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:23.014268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:23.016056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:23.016056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:23.016056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:23.016056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:23.016056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 09:35:23.016056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 09:35:23.016056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 09:35:23.016056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 09:35:23.016056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 09:35:23.016056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 09:35:23.016056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 09:35:23.016056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:23.016056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 649/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Wed Jun 15 09:35:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:23.020056 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fb704-4ca3-4273-8d6e-85eeac3b040c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:23.111034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:23.134254 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fb704-4ca3-4273-8d6e-85eeac3b040c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:23.191634 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b467d-2c96-47da-94f4-0b9c5568d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:23.193501 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b467d-2c96-47da-94f4-0b9c5568d907 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:23.194128 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b467d-2c96-47da-94f4-0b9c5568d907 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:23.194986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b467d-2c96-47da-94f4-0b9c5568d907 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:23.197237 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b467d-2c96-47da-94f4-0b9c5568d907 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:23.198190 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b467d-2c96-47da-94f4-0b9c5568d907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:23.202196 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b467d-2c96-47da-94f4-0b9c5568d907 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:23.217277 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 628/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Wed Jun 15 09:35:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:23.228090 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202057f-8e42-4a87-b8a2-15c66c5018c1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:23.358388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202057f-8e42-4a87-b8a2-15c66c5018c1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:23.397073 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa9830-874a-442c-9bba-e39d1b1512ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:23.397834 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa9830-874a-442c-9bba-e39d1b1512ce None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:23.398144 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa9830-874a-442c-9bba-e39d1b1512ce None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:23.398432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa9830-874a-442c-9bba-e39d1b1512ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:23.410917 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa9830-874a-442c-9bba-e39d1b1512ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:23.412584 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa9830-874a-442c-9bba-e39d1b1512ce None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:23.432163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-cdfa9830-874a-442c-9bba-e39d1b1512ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:23.432163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:23.432163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:23.432163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:23.432163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:23.432163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:23.432163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:23.432163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:23.432163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:23.432163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:23.432163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:23.432163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:23.432163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:35:23.432163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:35:23.432163 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:23.433297 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:23.434329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:35:23.434329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:35:23.434329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:23.434329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:23.434329 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 650/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:23.439316 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b467d-2c96-47da-94f4-0b9c5568d907 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:23.544630 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b467d-2c96-47da-94f4-0b9c5568d907 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:23.581158 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cfc1a-d934-49b6-b722-e2ceda2cf388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:23.581851 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cfc1a-d934-49b6-b722-e2ceda2cf388 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:23.582137 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cfc1a-d934-49b6-b722-e2ceda2cf388 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:23.582415 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cfc1a-d934-49b6-b722-e2ceda2cf388 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:23.583199 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cfc1a-d934-49b6-b722-e2ceda2cf388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:23.583507 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cfc1a-d934-49b6-b722-e2ceda2cf388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:23.584917 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cfc1a-d934-49b6-b722-e2ceda2cf388 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:23.599652 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 629/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:23.605944 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa9830-874a-442c-9bba-e39d1b1512ce None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:23.644261 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:23.724829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa9830-874a-442c-9bba-e39d1b1512ce None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:23.760337 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68931197-3993-474f-a115-afb2e72eedc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:23.761147 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68931197-3993-474f-a115-afb2e72eedc9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:23.761423 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68931197-3993-474f-a115-afb2e72eedc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:23.761896 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68931197-3993-474f-a115-afb2e72eedc9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:23.770257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68931197-3993-474f-a115-afb2e72eedc9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:23.771717 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68931197-3993-474f-a115-afb2e72eedc9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-68931197-3993-474f-a115-afb2e72eedc9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 09:35:23.786836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:23.788025 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:23.789228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:23.789228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:23.789228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 09:35:23.789228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 09:35:23.789228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 09:35:23.789228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 09:35:23.789228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 09:35:23.789228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 09:35:23.789228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 09:35:23.789228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:23.789228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 651/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:35:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:23.794406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cfc1a-d934-49b6-b722-e2ceda2cf388 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:23.798330 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:23.900595 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cfc1a-d934-49b6-b722-e2ceda2cf388 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:23.936520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29cd41-805e-408e-8448-dee7034d2374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:23.937192 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29cd41-805e-408e-8448-dee7034d2374 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:23.937474 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29cd41-805e-408e-8448-dee7034d2374 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:23.937760 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29cd41-805e-408e-8448-dee7034d2374 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:23.938630 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29cd41-805e-408e-8448-dee7034d2374 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:23.938952 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29cd41-805e-408e-8448-dee7034d2374 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:23.940388 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29cd41-805e-408e-8448-dee7034d2374 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:23.959061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 630/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Wed Jun 15 09:35:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:23.964972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68931197-3993-474f-a115-afb2e72eedc9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:24.060697 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:24.071444 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68931197-3993-474f-a115-afb2e72eedc9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:24.111498 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcd559-f0ad-4c58-9a2a-d6e1ee8b378e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:24.112365 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcd559-f0ad-4c58-9a2a-d6e1ee8b378e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:24.112650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcd559-f0ad-4c58-9a2a-d6e1ee8b378e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:24.113016 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcd559-f0ad-4c58-9a2a-d6e1ee8b378e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:24.187570 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcd559-f0ad-4c58-9a2a-d6e1ee8b378e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:24.189257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcd559-f0ad-4c58-9a2a-d6e1ee8b378e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:24.299421 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:24.311364 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 652/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Wed Jun 15 09:35:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 09:35:24.317754 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29cd41-805e-408e-8448-dee7034d2374 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:24.382329 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:24.424040 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29cd41-805e-408e-8448-dee7034d2374 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:24.461927 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49120c88-eb58-443a-aebc-bc4c623c8230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:24.462742 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49120c88-eb58-443a-aebc-bc4c623c8230 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:24.463080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49120c88-eb58-443a-aebc-bc4c623c8230 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:24.463430 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49120c88-eb58-443a-aebc-bc4c623c8230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:24.474397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49120c88-eb58-443a-aebc-bc4c623c8230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:24.475953 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49120c88-eb58-443a-aebc-bc4c623c8230 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:24.495011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-49120c88-eb58-443a-aebc-bc4c623c8230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:24.495011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:24.495011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:24.495011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:24.495011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:24.495011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:24.495011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:24.495011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:24.495011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:24.495011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:24.495011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:24.495011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:24.495011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 09:35:24.495011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 09:35:24.495011 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:24.496133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:24.497278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 09:35:24.497278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 09:35:24.497278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 09:35:24.497278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:35:24.497278 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 631/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:24.503057 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcd559-f0ad-4c58-9a2a-d6e1ee8b378e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:24.606843 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcd559-f0ad-4c58-9a2a-d6e1ee8b378e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:24.641943 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7611c-6d8d-4cb3-8a5d-b259da0aca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:24.642639 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7611c-6d8d-4cb3-8a5d-b259da0aca5b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:24.642930 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7611c-6d8d-4cb3-8a5d-b259da0aca5b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:24.643212 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7611c-6d8d-4cb3-8a5d-b259da0aca5b None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:24.643937 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7611c-6d8d-4cb3-8a5d-b259da0aca5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:24.644250 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7611c-6d8d-4cb3-8a5d-b259da0aca5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:24.645615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7611c-6d8d-4cb3-8a5d-b259da0aca5b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:24.659135 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 653/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Wed Jun 15 09:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:24.666203 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49120c88-eb58-443a-aebc-bc4c623c8230 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:24.776061 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49120c88-eb58-443a-aebc-bc4c623c8230 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:24.793031 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:24.814425 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4ff73-ac09-4d31-a218-828b14337bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:24.815257 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4ff73-ac09-4d31-a218-828b14337bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:24.815542 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4ff73-ac09-4d31-a218-828b14337bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:24.815820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4ff73-ac09-4d31-a218-828b14337bc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:24.822816 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4ff73-ac09-4d31-a218-828b14337bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:24.824349 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4ff73-ac09-4d31-a218-828b14337bc0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:24.840284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-2ac4ff73-ac09-4d31-a218-828b14337bc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:35:24.840284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:24.840284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:24.840284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:24.840284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:24.840284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:24.840284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:24.840284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:24.840284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:24.840284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:24.840284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:24.840284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:24.840284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 09:35:24.840284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 09:35:24.840284 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:24.842098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:24.843358 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 09:35:24.843358 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 09:35:24.843358 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 09:35:24.843358 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 09:35:24.843358 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 09:35:24.843358 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 09:35:24.843358 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 09:35:24.843358 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Jun 15 09:35:24.843358 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 632/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Wed Jun 15 09:35:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:24.849806 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7611c-6d8d-4cb3-8a5d-b259da0aca5b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:24.909282 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:24.963427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7611c-6d8d-4cb3-8a5d-b259da0aca5b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:24.999157 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babd0a1-baaa-4e61-820b-5c87a64f5719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:24.999821 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babd0a1-baaa-4e61-820b-5c87a64f5719 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:25.000107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babd0a1-baaa-4e61-820b-5c87a64f5719 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:25.000389 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babd0a1-baaa-4e61-820b-5c87a64f5719 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:25.001177 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babd0a1-baaa-4e61-820b-5c87a64f5719 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:25.001490 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babd0a1-baaa-4e61-820b-5c87a64f5719 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:25.002961 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babd0a1-baaa-4e61-820b-5c87a64f5719 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:25.015247 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 654/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Wed Jun 15 09:35:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:25.021627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4ff73-ac09-4d31-a218-828b14337bc0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:25.128671 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4ff73-ac09-4d31-a218-828b14337bc0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:25.166810 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f7003-77f2-4eb0-b175-d7caab68a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:25.167456 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f7003-77f2-4eb0-b175-d7caab68a988 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:25.167740 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f7003-77f2-4eb0-b175-d7caab68a988 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:25.168015 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f7003-77f2-4eb0-b175-d7caab68a988 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:25.168875 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f7003-77f2-4eb0-b175-d7caab68a988 None admin] RBAC: Adding query filter params (role.id=efaf387c51e14931820f2a9b33ac5175, scope.project.id=b978d75b349941f5bedbe56544f41ada, user.id=ebadf82546c5464ab21a467a50c70513) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:25.169253 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f7003-77f2-4eb0-b175-d7caab68a988 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:25.171479 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f7003-77f2-4eb0-b175-d7caab68a988 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:25.177897 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 633/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Wed Jun 15 09:35:25 2022] GET /identity/v3/role_assignments?user.id=ebadf82546c5464ab21a467a50c70513&scope.project.id=b978d75b349941f5bedbe56544f41ada&role.id=efaf387c51e14931820f2a9b33ac5175 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:27.407788 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595ddbb-0903-49b2-b1fa-e14e2eb9cf04 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:27.408438 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595ddbb-0903-49b2-b1fa-e14e2eb9cf04 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:27.408438 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595ddbb-0903-49b2-b1fa-e14e2eb9cf04 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:27.409983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 655/1288] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:35:27.416028 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbdbd6-95dc-46af-93ef-b7d11a96f518 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:27.416485 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbdbd6-95dc-46af-93ef-b7d11a96f518 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:27.416575 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbdbd6-95dc-46af-93ef-b7d11a96f518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:27.434695 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-19dbdbd6-95dc-46af-93ef-b7d11a96f518 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:35:27.435960 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-19dbdbd6-95dc-46af-93ef-b7d11a96f518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:35:27.469553 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:27.513971 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 634/1289] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:35:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 09:35:27.539956 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595ddbb-0903-49b2-b1fa-e14e2eb9cf04 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:27.647665 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595ddbb-0903-49b2-b1fa-e14e2eb9cf04 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:27.659968 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:27.684829 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ab6da-8b20-437c-be70-a8d5657b915b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:27.685694 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ab6da-8b20-437c-be70-a8d5657b915b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:27.685975 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ab6da-8b20-437c-be70-a8d5657b915b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:27.686250 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ab6da-8b20-437c-be70-a8d5657b915b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:27.686938 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ab6da-8b20-437c-be70-a8d5657b915b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:27.688314 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ab6da-8b20-437c-be70-a8d5657b915b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c49ab6da-8b20-437c-be70-a8d5657b915b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:27.701428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:27.703504 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:27.705339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:27.705339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:27.705339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:27.705339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:27.705339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:27.705339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:27.705339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:27.705339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:27.705339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:27.705339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:27.705339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:35:27.705339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:35:27.705339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 09:35:27.705339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:27.705339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 656/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Jun 15 09:35:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:27.709276 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbdbd6-95dc-46af-93ef-b7d11a96f518 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:27.823630 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbdbd6-95dc-46af-93ef-b7d11a96f518 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:27.862852 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f2a8f-4ec0-414f-b718-c9135a662747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:27.863549 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f2a8f-4ec0-414f-b718-c9135a662747 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:27.863836 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f2a8f-4ec0-414f-b718-c9135a662747 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:27.864119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f2a8f-4ec0-414f-b718-c9135a662747 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:27.864843 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f2a8f-4ec0-414f-b718-c9135a662747 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:27.865159 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f2a8f-4ec0-414f-b718-c9135a662747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:27.866565 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f2a8f-4ec0-414f-b718-c9135a662747 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:27.873323 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 635/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Jun 15 09:35:27 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 09:35:27.879848 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ab6da-8b20-437c-be70-a8d5657b915b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:27.999474 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ab6da-8b20-437c-be70-a8d5657b915b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:28.034950 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf508c-e722-43b0-bdd9-55da9ceef97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:28.035623 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf508c-e722-43b0-bdd9-55da9ceef97d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:28.035910 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf508c-e722-43b0-bdd9-55da9ceef97d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:28.036186 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf508c-e722-43b0-bdd9-55da9ceef97d None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:28.036894 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf508c-e722-43b0-bdd9-55da9ceef97d None admin] RBAC: Adding query filter params (type=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:28.037202 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf508c-e722-43b0-bdd9-55da9ceef97d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:28.038641 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf508c-e722-43b0-bdd9-55da9ceef97d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:28.043634 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 657/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Jun 15 09:35:27 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:30.366439 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233ede3-f9d7-4d2e-b868-984ee7bfb1c1 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:30.367087 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233ede3-f9d7-4d2e-b868-984ee7bfb1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:30.367087 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233ede3-f9d7-4d2e-b868-984ee7bfb1c1 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:30.368810 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 636/1293] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:35:30.375253 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cc704-9ed0-4a62-a893-d89bc6e230bd None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:30.375783 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cc704-9ed0-4a62-a893-d89bc6e230bd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:30.375963 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cc704-9ed0-4a62-a893-d89bc6e230bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:30.397615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e47cc704-9ed0-4a62-a893-d89bc6e230bd None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:35:30.399201 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e47cc704-9ed0-4a62-a893-d89bc6e230bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:35:30.437741 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:30.480432 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 658/1294] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:35:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:35:30.507720 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233ede3-f9d7-4d2e-b868-984ee7bfb1c1 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:30.546797 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:30.632347 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233ede3-f9d7-4d2e-b868-984ee7bfb1c1 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:30.669457 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1b791-0bae-4648-b47a-476ae0483772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:30.670136 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1b791-0bae-4648-b47a-476ae0483772 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:30.670478 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1b791-0bae-4648-b47a-476ae0483772 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:30.670829 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1b791-0bae-4648-b47a-476ae0483772 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:30.671517 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1b791-0bae-4648-b47a-476ae0483772 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:30.672887 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1b791-0bae-4648-b47a-476ae0483772 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:30.686987 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 637/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Wed Jun 15 09:35:30 2022] POST /identity/v3/services => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:35:32.982756 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a69bd4-357f-43b6-bff1-119708aea9c3 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:32.983260 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a69bd4-357f-43b6-bff1-119708aea9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:32.983260 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a69bd4-357f-43b6-bff1-119708aea9c3 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:32.984604 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 659/1296] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:35:32.990345 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f68de-7fde-4c9a-a198-505038ec3ed2 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:32.990861 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f68de-7fde-4c9a-a198-505038ec3ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:32.991357 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f68de-7fde-4c9a-a198-505038ec3ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:33.009861 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-516f68de-7fde-4c9a-a198-505038ec3ed2 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:35:33.011116 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-516f68de-7fde-4c9a-a198-505038ec3ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:35:33.089080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 638/1297] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:35:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:35:33.113207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a69bd4-357f-43b6-bff1-119708aea9c3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:33.251761 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a69bd4-357f-43b6-bff1-119708aea9c3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:33.288625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca7a89-6a23-4dcc-b440-bfd863677d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:33.289506 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca7a89-6a23-4dcc-b440-bfd863677d69 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:33.289790 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca7a89-6a23-4dcc-b440-bfd863677d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:33.290071 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca7a89-6a23-4dcc-b440-bfd863677d69 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:33.290754 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca7a89-6a23-4dcc-b440-bfd863677d69 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:33.292139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca7a89-6a23-4dcc-b440-bfd863677d69 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-96ca7a89-6a23-4dcc-b440-bfd863677d69 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:33.305993 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:33.308865 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:33.310131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:33.310131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:33.310131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:33.310131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:33.310131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:33.310131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:33.310131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:33.310131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:33.310131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:33.310131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:33.310131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:35:33.310131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:35:33.310131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 09:35:33.310131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:33.310131 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 660/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Jun 15 09:35:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 09:35:33.314256 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f68de-7fde-4c9a-a198-505038ec3ed2 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:33.333091 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:33.433036 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f68de-7fde-4c9a-a198-505038ec3ed2 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:33.471500 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054fe6c-d8e3-4035-a1aa-db089786331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:33.472232 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054fe6c-d8e3-4035-a1aa-db089786331e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:33.472557 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054fe6c-d8e3-4035-a1aa-db089786331e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:33.472873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054fe6c-d8e3-4035-a1aa-db089786331e None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:33.473618 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054fe6c-d8e3-4035-a1aa-db089786331e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:33.473978 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054fe6c-d8e3-4035-a1aa-db089786331e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:33.475503 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054fe6c-d8e3-4035-a1aa-db089786331e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:33.481795 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 639/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Jun 15 09:35:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:33.488175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca7a89-6a23-4dcc-b440-bfd863677d69 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:33.524625 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:33.614878 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca7a89-6a23-4dcc-b440-bfd863677d69 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:33.656861 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1fb2d-689a-4536-ad64-fffb6596060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:33.657544 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1fb2d-689a-4536-ad64-fffb6596060b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:33.657834 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1fb2d-689a-4536-ad64-fffb6596060b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:33.658117 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1fb2d-689a-4536-ad64-fffb6596060b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:33.658981 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1fb2d-689a-4536-ad64-fffb6596060b None admin] RBAC: Adding query filter params (interface=public, service_id=3a8857daebb64b08b882b6365cf4ae39, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:33.659306 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1fb2d-689a-4536-ad64-fffb6596060b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:33.660742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1fb2d-689a-4536-ad64-fffb6596060b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:33.666782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 661/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Wed Jun 15 09:35:33 2022] GET /identity/v3/endpoints?service_id=3a8857daebb64b08b882b6365cf4ae39&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:33.672783 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054fe6c-d8e3-4035-a1aa-db089786331e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:33.765111 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:33.785903 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054fe6c-d8e3-4035-a1aa-db089786331e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:33.823357 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02ff0e-fdd3-4a0b-818e-32dc4780accd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:33.824038 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02ff0e-fdd3-4a0b-818e-32dc4780accd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:33.824331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02ff0e-fdd3-4a0b-818e-32dc4780accd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:33.824614 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02ff0e-fdd3-4a0b-818e-32dc4780accd None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:33.825848 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02ff0e-fdd3-4a0b-818e-32dc4780accd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:33.827286 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02ff0e-fdd3-4a0b-818e-32dc4780accd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:33.834806 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 640/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Wed Jun 15 09:35:33 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 09:35:35.981803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51629a08-963d-4fb5-80a1-4a666fce9b89 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:35.982323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51629a08-963d-4fb5-80a1-4a666fce9b89 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:35.982323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51629a08-963d-4fb5-80a1-4a666fce9b89 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:35.983682 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 662/1302] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:35:35.989005 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe39e3d-e88e-488a-bf6e-bf8eb6fbd158 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:35.989424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe39e3d-e88e-488a-bf6e-bf8eb6fbd158 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:35.989564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe39e3d-e88e-488a-bf6e-bf8eb6fbd158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:36.006397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-9fe39e3d-e88e-488a-bf6e-bf8eb6fbd158 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:35:36.007627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9fe39e3d-e88e-488a-bf6e-bf8eb6fbd158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:35:36.074079 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 641/1303] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:35:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 09:35:36.097814 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51629a08-963d-4fb5-80a1-4a666fce9b89 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:36.202489 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:36.209614 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51629a08-963d-4fb5-80a1-4a666fce9b89 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:36.243831 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879a8fe-bc79-4fbc-91be-ea35e7a62a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:36.244635 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879a8fe-bc79-4fbc-91be-ea35e7a62a63 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:36.244921 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879a8fe-bc79-4fbc-91be-ea35e7a62a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:36.245201 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879a8fe-bc79-4fbc-91be-ea35e7a62a63 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:36.245850 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879a8fe-bc79-4fbc-91be-ea35e7a62a63 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:36.247264 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879a8fe-bc79-4fbc-91be-ea35e7a62a63 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e879a8fe-bc79-4fbc-91be-ea35e7a62a63 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 09:35:36.259097 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 09:35:36.260618 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 09:35:36.261685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 09:35:36.261685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Jun 15 09:35:36.261685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 09:35:36.261685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Jun 15 09:35:36.261685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 09:35:36.261685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 09:35:36.261685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 09:35:36.261685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Jun 15 09:35:36.261685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 09:35:36.261685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Jun 15 09:35:36.261685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 09:35:36.261685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 09:35:36.261685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 09:35:36.261685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Jun 15 09:35:36.261685 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 663/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Wed Jun 15 09:35:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 09:35:36.266402 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe39e3d-e88e-488a-bf6e-bf8eb6fbd158 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:36.343318 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:36.368912 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe39e3d-e88e-488a-bf6e-bf8eb6fbd158 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:36.401947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3ee4d-30b8-453d-9ab7-4e10874c253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:36.403127 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3ee4d-30b8-453d-9ab7-4e10874c253a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:36.403421 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3ee4d-30b8-453d-9ab7-4e10874c253a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:36.403697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3ee4d-30b8-453d-9ab7-4e10874c253a None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:36.404397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3ee4d-30b8-453d-9ab7-4e10874c253a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:35:36.404702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3ee4d-30b8-453d-9ab7-4e10874c253a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:36.406060 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3ee4d-30b8-453d-9ab7-4e10874c253a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:36.411468 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 642/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Wed Jun 15 09:35:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:35:36.417507 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879a8fe-bc79-4fbc-91be-ea35e7a62a63 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:35:36.517484 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879a8fe-bc79-4fbc-91be-ea35e7a62a63 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:35:36.553909 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab31f14-7c7f-4ce4-b167-be8f69747fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:35:36.554585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab31f14-7c7f-4ce4-b167-be8f69747fa5 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:35:36.554873 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab31f14-7c7f-4ce4-b167-be8f69747fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:35:36.555154 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab31f14-7c7f-4ce4-b167-be8f69747fa5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:35:36.555902 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab31f14-7c7f-4ce4-b167-be8f69747fa5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:35:36.557269 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab31f14-7c7f-4ce4-b167-be8f69747fa5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:35:36.575899 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 664/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Wed Jun 15 09:35:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:35:46.408195 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=30 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:35:46.570950 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:36:41.926133 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0b30d-6282-4fbd-bf80-4aa57c90b061 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:41.927074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0b30d-6282-4fbd-bf80-4aa57c90b061 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:41.927074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0b30d-6282-4fbd-bf80-4aa57c90b061 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:41.930973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 643/1307] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:36:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:36:41.937371 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fdb61-a061-4551-932b-06a7804f81d2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:41.939018 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fdb61-a061-4551-932b-06a7804f81d2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:41.940204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fdb61-a061-4551-932b-06a7804f81d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:42.091331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e61fdb61-a061-4551-932b-06a7804f81d2 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:36:42.093200 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e61fdb61-a061-4551-932b-06a7804f81d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:42.224898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 665/1308] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:36:42.293817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320bc96-0b23-4563-878b-457aaa361297 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:42.294370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320bc96-0b23-4563-878b-457aaa361297 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:42.294838 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320bc96-0b23-4563-878b-457aaa361297 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:42.296820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 644/1309] 10.222.0.45 () {54 vars in 964 bytes} [Wed Jun 15 09:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:36:42.303134 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9da6d-9a66-493c-9edf-1967e45d4284 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:42.303421 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9da6d-9a66-493c-9edf-1967e45d4284 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:42.303710 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9da6d-9a66-493c-9edf-1967e45d4284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:42.391638 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-15f9da6d-9a66-493c-9edf-1967e45d4284 None None] MFA Rules not processed for user `68a7bf928d4e46c182e22687befcdea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:36:42.392863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-15f9da6d-9a66-493c-9edf-1967e45d4284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:42.416887 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:36:42.484437 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 666/1310] 10.222.0.45 () {58 vars in 1061 bytes} [Wed Jun 15 09:36:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:36:42.493801 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320bc96-0b23-4563-878b-457aaa361297 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:36:42.496082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2320bc96-0b23-4563-878b-457aaa361297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:42.654277 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320bc96-0b23-4563-878b-457aaa361297 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:36:42.744164 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197c614-974e-4ff1-a16d-895b3f087824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:36:42.744820 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197c614-974e-4ff1-a16d-895b3f087824 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:42.745112 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197c614-974e-4ff1-a16d-895b3f087824 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:42.745646 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197c614-974e-4ff1-a16d-895b3f087824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:42.747532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8197c614-974e-4ff1-a16d-895b3f087824 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:42.811492 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:36:42.877263 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197c614-974e-4ff1-a16d-895b3f087824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:36:42.879103 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197c614-974e-4ff1-a16d-895b3f087824 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:36:42.906624 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 645/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:36:45.502813 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da789541-a37b-4d77-b6fb-83429051767e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:45.503375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da789541-a37b-4d77-b6fb-83429051767e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:45.503375 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da789541-a37b-4d77-b6fb-83429051767e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:45.504787 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 667/1312] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:36:45.510082 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9347338-a2aa-4851-9fce-1aeb128a1da5 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:45.510560 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9347338-a2aa-4851-9fce-1aeb128a1da5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:45.510675 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9347338-a2aa-4851-9fce-1aeb128a1da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:45.604179 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e9347338-a2aa-4851-9fce-1aeb128a1da5 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:36:45.605453 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e9347338-a2aa-4851-9fce-1aeb128a1da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:45.728898 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 646/1313] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:36:45.767108 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da789541-a37b-4d77-b6fb-83429051767e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:36:45.768673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-da789541-a37b-4d77-b6fb-83429051767e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:45.875785 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da789541-a37b-4d77-b6fb-83429051767e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:36:45.949119 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:36:45.952159 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d8886-29a0-4ff6-9a91-868cadbfbede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:36:45.953075 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d8886-29a0-4ff6-9a91-868cadbfbede service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:45.953531 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d8886-29a0-4ff6-9a91-868cadbfbede service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:45.954053 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d8886-29a0-4ff6-9a91-868cadbfbede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:45.956077 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f69d8886-29a0-4ff6-9a91-868cadbfbede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:46.077135 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d8886-29a0-4ff6-9a91-868cadbfbede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:36:46.078650 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d8886-29a0-4ff6-9a91-868cadbfbede service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:36:46.101251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 668/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:36:48.559686 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380b108-0474-44c8-ac3f-2917512e5aff None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:48.560200 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380b108-0474-44c8-ac3f-2917512e5aff None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:48.560294 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380b108-0474-44c8-ac3f-2917512e5aff None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:48.561616 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 647/1315] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:36:48.566836 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe520f-fea0-4382-877b-c7e6f808671b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:48.567240 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe520f-fea0-4382-877b-c7e6f808671b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:48.567396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe520f-fea0-4382-877b-c7e6f808671b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:48.632123 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d4fe520f-fea0-4382-877b-c7e6f808671b None None] MFA Rules not processed for user `bd892ec4fbfa4f31bcd7d81f7be2ea09`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:36:48.633361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d4fe520f-fea0-4382-877b-c7e6f808671b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:48.688792 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:36:48.733875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 669/1316] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:36:48 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:36:48.773325 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380b108-0474-44c8-ac3f-2917512e5aff None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:36:48.774939 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7380b108-0474-44c8-ac3f-2917512e5aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:48.785372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:36:48.883428 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380b108-0474-44c8-ac3f-2917512e5aff None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:36:48.957834 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc17ff-f040-4d28-afd2-6e251d44f0dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:36:48.958787 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc17ff-f040-4d28-afd2-6e251d44f0dd service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:48.959072 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc17ff-f040-4d28-afd2-6e251d44f0dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:48.959349 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc17ff-f040-4d28-afd2-6e251d44f0dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:48.961015 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1ffc17ff-f040-4d28-afd2-6e251d44f0dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:49.026098 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:36:49.075737 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc17ff-f040-4d28-afd2-6e251d44f0dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:36:49.077180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc17ff-f040-4d28-afd2-6e251d44f0dd service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:36:49.099510 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 648/1317] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:36:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:36:51.811339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33967c-8c55-427f-8169-56ed4f223527 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:51.811870 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33967c-8c55-427f-8169-56ed4f223527 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:51.811870 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33967c-8c55-427f-8169-56ed4f223527 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:51.813183 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 670/1318] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:36:51.819432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745470b-31d5-42cf-9d81-41dabc2201c1 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:51.819945 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745470b-31d5-42cf-9d81-41dabc2201c1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:51.820099 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745470b-31d5-42cf-9d81-41dabc2201c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:51.889295 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-3745470b-31d5-42cf-9d81-41dabc2201c1 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:36:51.890635 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3745470b-31d5-42cf-9d81-41dabc2201c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:51.998200 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 649/1319] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:36:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:36:52.052206 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee05fc-d178-488c-9a6d-70f582ef846a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:52.052547 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee05fc-d178-488c-9a6d-70f582ef846a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:52.052911 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee05fc-d178-488c-9a6d-70f582ef846a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:52.054338 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 671/1320] 10.222.0.45 () {54 vars in 964 bytes} [Wed Jun 15 09:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:36:52.061081 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efcc4b-38b7-43fd-817e-af5b3e9bac0b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:52.061426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efcc4b-38b7-43fd-817e-af5b3e9bac0b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:52.061666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efcc4b-38b7-43fd-817e-af5b3e9bac0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:52.084214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:36:52.144631 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-43efcc4b-38b7-43fd-817e-af5b3e9bac0b None None] MFA Rules not processed for user `68a7bf928d4e46c182e22687befcdea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:36:52.145922 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-43efcc4b-38b7-43fd-817e-af5b3e9bac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:52.241127 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 650/1321] 10.222.0.45 () {58 vars in 1061 bytes} [Wed Jun 15 09:36:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 09:36:52.250696 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee05fc-d178-488c-9a6d-70f582ef846a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:36:52.252252 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d5ee05fc-d178-488c-9a6d-70f582ef846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:52.373499 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee05fc-d178-488c-9a6d-70f582ef846a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:36:52.452378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ff721-bc54-4ce7-a82e-78cfd2c25ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:36:52.453047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ff721-bc54-4ce7-a82e-78cfd2c25ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:52.453331 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ff721-bc54-4ce7-a82e-78cfd2c25ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:52.453611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ff721-bc54-4ce7-a82e-78cfd2c25ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:52.455328 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f27ff721-bc54-4ce7-a82e-78cfd2c25ca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:52.463223 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:36:52.568382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ff721-bc54-4ce7-a82e-78cfd2c25ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:36:52.569807 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ff721-bc54-4ce7-a82e-78cfd2c25ca6 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:36:52.588123 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 672/1322] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:36:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:36:56.242383 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329e003-cf1e-4dde-9572-41d99b04afd7 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:56.243071 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329e003-cf1e-4dde-9572-41d99b04afd7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:56.243071 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329e003-cf1e-4dde-9572-41d99b04afd7 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:56.244859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 651/1323] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:36:56.250838 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485d583-3cc6-4ded-8bcb-bbf663344195 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:56.251427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485d583-3cc6-4ded-8bcb-bbf663344195 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:56.251427 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485d583-3cc6-4ded-8bcb-bbf663344195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:56.340069 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e485d583-3cc6-4ded-8bcb-bbf663344195 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:36:56.341352 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e485d583-3cc6-4ded-8bcb-bbf663344195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:56.413495 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:36:56.461702 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 673/1324] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 09:36:56.499664 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329e003-cf1e-4dde-9572-41d99b04afd7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:36:56.501359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8329e003-cf1e-4dde-9572-41d99b04afd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:56.616298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329e003-cf1e-4dde-9572-41d99b04afd7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:36:56.631075 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:36:56.744171 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da4802-4938-4e3c-8059-015e010588c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:36:56.745228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da4802-4938-4e3c-8059-015e010588c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:56.745680 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da4802-4938-4e3c-8059-015e010588c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:56.746150 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da4802-4938-4e3c-8059-015e010588c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:56.749230 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-85da4802-4938-4e3c-8059-015e010588c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:36:56.918356 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da4802-4938-4e3c-8059-015e010588c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:36:56.921119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da4802-4938-4e3c-8059-015e010588c3 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:36:56.955989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 652/1325] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:36:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:36:59.878517 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8aa2c-3ee0-4fe1-b462-213f9aa5996e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:59.879253 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8aa2c-3ee0-4fe1-b462-213f9aa5996e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:59.879253 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8aa2c-3ee0-4fe1-b462-213f9aa5996e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:59.881020 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 674/1326] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:36:59.887899 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74672b25-fd36-4dc6-a419-924d09b2ae6d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:36:59.888503 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74672b25-fd36-4dc6-a419-924d09b2ae6d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:36:59.888776 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74672b25-fd36-4dc6-a419-924d09b2ae6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:36:59.958804 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:36:59.981152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-74672b25-fd36-4dc6-a419-924d09b2ae6d None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:36:59.982452 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-74672b25-fd36-4dc6-a419-924d09b2ae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:00.151852 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 653/1327] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:00.203144 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8aa2c-3ee0-4fe1-b462-213f9aa5996e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:00.205515 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a1e8aa2c-3ee0-4fe1-b462-213f9aa5996e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:00.400779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8aa2c-3ee0-4fe1-b462-213f9aa5996e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:00.523779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b2d52-72cf-447a-9747-526f999bf156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:00.524710 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b2d52-72cf-447a-9747-526f999bf156 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:00.525126 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b2d52-72cf-447a-9747-526f999bf156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:00.525525 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b2d52-72cf-447a-9747-526f999bf156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:00.527672 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-276b2d52-72cf-447a-9747-526f999bf156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:00.551445 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:37:00.675827 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b2d52-72cf-447a-9747-526f999bf156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:00.677562 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b2d52-72cf-447a-9747-526f999bf156 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:00.700962 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 675/1328] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:37:02.953173 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afe910-9e2c-4326-9a09-ba7a7aa670bc None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:02.953734 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afe910-9e2c-4326-9a09-ba7a7aa670bc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:02.953734 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afe910-9e2c-4326-9a09-ba7a7aa670bc None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:02.955160 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 654/1329] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:02.960912 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7069c0-8c36-48a5-8eb8-95dc668d106f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:02.961370 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7069c0-8c36-48a5-8eb8-95dc668d106f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:02.961486 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7069c0-8c36-48a5-8eb8-95dc668d106f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:03.047688 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-aa7069c0-8c36-48a5-8eb8-95dc668d106f None None] MFA Rules not processed for user `bd892ec4fbfa4f31bcd7d81f7be2ea09`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:03.049534 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-aa7069c0-8c36-48a5-8eb8-95dc668d106f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:03.113672 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:37:03.146991 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 676/1330] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:03.185243 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afe910-9e2c-4326-9a09-ba7a7aa670bc None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:03.186871 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e3afe910-9e2c-4326-9a09-ba7a7aa670bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:03.299904 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afe910-9e2c-4326-9a09-ba7a7aa670bc None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:03.321048 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:37:03.384155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe29ca-d024-4a35-8dea-016f5c40ca94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:03.384815 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe29ca-d024-4a35-8dea-016f5c40ca94 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:03.385094 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe29ca-d024-4a35-8dea-016f5c40ca94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:03.385368 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe29ca-d024-4a35-8dea-016f5c40ca94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:03.387105 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-befe29ca-d024-4a35-8dea-016f5c40ca94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:03.507380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe29ca-d024-4a35-8dea-016f5c40ca94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:03.508817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe29ca-d024-4a35-8dea-016f5c40ca94 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:03.530411 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 655/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:37:05.913939 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c191f-a383-40f3-84ef-89d3327a504c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:05.914846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c191f-a383-40f3-84ef-89d3327a504c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:05.914998 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c191f-a383-40f3-84ef-89d3327a504c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:05.917387 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 677/1332] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:05.922786 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d650-0927-404b-aaf6-6b2e0ec7767b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:05.923868 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d650-0927-404b-aaf6-6b2e0ec7767b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:05.923973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d650-0927-404b-aaf6-6b2e0ec7767b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:05.987542 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:37:05.990480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e018d650-0927-404b-aaf6-6b2e0ec7767b None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:05.992380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e018d650-0927-404b-aaf6-6b2e0ec7767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:06.104366 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 656/1333] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:06.143405 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c191f-a383-40f3-84ef-89d3327a504c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:06.145230 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-902c191f-a383-40f3-84ef-89d3327a504c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:06.266312 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c191f-a383-40f3-84ef-89d3327a504c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:06.348795 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ce4ce-62d7-4193-94a0-749df2cde381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:06.349451 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ce4ce-62d7-4193-94a0-749df2cde381 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:06.349737 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ce4ce-62d7-4193-94a0-749df2cde381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:06.350012 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ce4ce-62d7-4193-94a0-749df2cde381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:06.351745 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3f5ce4ce-62d7-4193-94a0-749df2cde381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:06.380742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:37:06.467279 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ce4ce-62d7-4193-94a0-749df2cde381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:06.468651 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ce4ce-62d7-4193-94a0-749df2cde381 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:06.487875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 678/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:37:08.678437 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440390e-46e4-4658-b440-489e1f9fd317 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:08.679047 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440390e-46e4-4658-b440-489e1f9fd317 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:08.679047 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440390e-46e4-4658-b440-489e1f9fd317 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:08.680481 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 657/1335] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:08.686588 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17913f-af34-4b82-b7ac-ba27d66b4b8f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:08.687167 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17913f-af34-4b82-b7ac-ba27d66b4b8f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:08.687167 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17913f-af34-4b82-b7ac-ba27d66b4b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:08.757736 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6a17913f-af34-4b82-b7ac-ba27d66b4b8f None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:08.758994 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6a17913f-af34-4b82-b7ac-ba27d66b4b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:08.837200 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:37:08.861068 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 679/1336] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:08.900406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440390e-46e4-4658-b440-489e1f9fd317 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:08.901953 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d440390e-46e4-4658-b440-489e1f9fd317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:09.014989 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440390e-46e4-4658-b440-489e1f9fd317 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:09.043351 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:37:09.089948 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1b4cc-2085-4d05-bf36-fcc692216591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:09.090604 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1b4cc-2085-4d05-bf36-fcc692216591 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:09.090863 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1b4cc-2085-4d05-bf36-fcc692216591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:09.091169 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1b4cc-2085-4d05-bf36-fcc692216591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:09.093246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-75b1b4cc-2085-4d05-bf36-fcc692216591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:09.215730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1b4cc-2085-4d05-bf36-fcc692216591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:09.217186 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1b4cc-2085-4d05-bf36-fcc692216591 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:09.237666 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 658/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:37:11.853280 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61144321-fde9-4455-aea7-7c58cad6c053 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:11.853822 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61144321-fde9-4455-aea7-7c58cad6c053 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:11.853822 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61144321-fde9-4455-aea7-7c58cad6c053 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:11.855168 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 680/1338] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:11.861586 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e56da-b449-4f19-bb72-a04361af8eac None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:11.862104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e56da-b449-4f19-bb72-a04361af8eac None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:11.862210 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e56da-b449-4f19-bb72-a04361af8eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:11.929119 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-385e56da-b449-4f19-bb72-a04361af8eac None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:11.930377 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-385e56da-b449-4f19-bb72-a04361af8eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:11.938870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:37:12.027734 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 659/1339] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:12.064182 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61144321-fde9-4455-aea7-7c58cad6c053 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:12.067291 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-61144321-fde9-4455-aea7-7c58cad6c053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:12.179636 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61144321-fde9-4455-aea7-7c58cad6c053 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:12.192137 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742b5ca-15ee-42a8-9bb7-b5cd7c0e44ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:12.192786 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742b5ca-15ee-42a8-9bb7-b5cd7c0e44ec service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:12.193069 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742b5ca-15ee-42a8-9bb7-b5cd7c0e44ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:12.193347 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742b5ca-15ee-42a8-9bb7-b5cd7c0e44ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:12.195023 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2742b5ca-15ee-42a8-9bb7-b5cd7c0e44ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:12.306215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:37:12.308701 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742b5ca-15ee-42a8-9bb7-b5cd7c0e44ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:12.310428 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742b5ca-15ee-42a8-9bb7-b5cd7c0e44ec service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:12.332397 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 681/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:37:16.522329 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee182df-490a-4852-88ee-730498c44554 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:16.523641 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee182df-490a-4852-88ee-730498c44554 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:16.523932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee182df-490a-4852-88ee-730498c44554 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:16.525461 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 660/1341] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:16.531973 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2236b7-b04f-409a-a069-40fb9b0b586d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:16.532673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2236b7-b04f-409a-a069-40fb9b0b586d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:16.532673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2236b7-b04f-409a-a069-40fb9b0b586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:16.585154 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6d2236b7-b04f-409a-a069-40fb9b0b586d None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:16.586310 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6d2236b7-b04f-409a-a069-40fb9b0b586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:16.672316 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 682/1342] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:16.710796 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee182df-490a-4852-88ee-730498c44554 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:16.713152 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3ee182df-490a-4852-88ee-730498c44554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:16.737512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee182df-490a-4852-88ee-730498c44554 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:16.741248 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40462e4-6522-42cf-ad4b-170445f1dc7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:16.741966 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40462e4-6522-42cf-ad4b-170445f1dc7d service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:16.742316 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40462e4-6522-42cf-ad4b-170445f1dc7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:16.742694 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40462e4-6522-42cf-ad4b-170445f1dc7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:16.752226 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40462e4-6522-42cf-ad4b-170445f1dc7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:16.753668 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40462e4-6522-42cf-ad4b-170445f1dc7d service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:16.763579 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 661/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:37:19.729026 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12ba2d-a68d-4fa8-817c-d9d50988b7f2 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:19.729585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12ba2d-a68d-4fa8-817c-d9d50988b7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:19.729585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12ba2d-a68d-4fa8-817c-d9d50988b7f2 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:19.731078 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 683/1344] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:19.736697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaa68e-8183-4bc3-bec9-14006ca70f3b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:19.737214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaa68e-8183-4bc3-bec9-14006ca70f3b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:19.737580 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaa68e-8183-4bc3-bec9-14006ca70f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:19.768416 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5fdaa68e-8183-4bc3-bec9-14006ca70f3b None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:19.769708 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5fdaa68e-8183-4bc3-bec9-14006ca70f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:19.778077 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 662/1345] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:19.816991 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12ba2d-a68d-4fa8-817c-d9d50988b7f2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:19.828967 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12ba2d-a68d-4fa8-817c-d9d50988b7f2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:19.832894 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24e443-741b-4810-83ba-d9c7e2a7c03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:19.833632 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24e443-741b-4810-83ba-d9c7e2a7c03c service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:19.833921 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24e443-741b-4810-83ba-d9c7e2a7c03c service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:19.834281 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24e443-741b-4810-83ba-d9c7e2a7c03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:19.844907 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24e443-741b-4810-83ba-d9c7e2a7c03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:19.846399 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24e443-741b-4810-83ba-d9c7e2a7c03c service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:19.857703 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 684/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:37:24.291651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c580755-255a-4742-80a9-81a2e2575452 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:24.292265 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c580755-255a-4742-80a9-81a2e2575452 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:24.292265 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c580755-255a-4742-80a9-81a2e2575452 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:24.293586 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 663/1347] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:24.299266 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c575c24-2d43-4d55-8981-58b7b8c9da84 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:24.299794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c575c24-2d43-4d55-8981-58b7b8c9da84 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:24.299904 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c575c24-2d43-4d55-8981-58b7b8c9da84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:24.318717 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7c575c24-2d43-4d55-8981-58b7b8c9da84 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:24.319984 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7c575c24-2d43-4d55-8981-58b7b8c9da84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:24.328363 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 685/1348] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:24.367442 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c580755-255a-4742-80a9-81a2e2575452 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:24.379385 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c580755-255a-4742-80a9-81a2e2575452 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:24.382991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58901f83-c3b0-4514-85d1-c5834243a383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:24.383651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58901f83-c3b0-4514-85d1-c5834243a383 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:24.383932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58901f83-c3b0-4514-85d1-c5834243a383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:24.384204 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58901f83-c3b0-4514-85d1-c5834243a383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:24.394386 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58901f83-c3b0-4514-85d1-c5834243a383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:24.395859 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58901f83-c3b0-4514-85d1-c5834243a383 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:24.406696 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 664/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:37:29.557947 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fb031-bd1b-461a-9c49-ab68b4900540 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:29.558469 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fb031-bd1b-461a-9c49-ab68b4900540 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:29.558679 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fb031-bd1b-461a-9c49-ab68b4900540 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:29.560268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 686/1350] 10.222.0.45 () {54 vars in 921 bytes} [Wed Jun 15 09:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:29.565724 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376cb35-8edd-4c44-b3b5-0a780068814a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:29.566160 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376cb35-8edd-4c44-b3b5-0a780068814a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:29.566290 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376cb35-8edd-4c44-b3b5-0a780068814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:29.696870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0376cb35-8edd-4c44-b3b5-0a780068814a None None] MFA Rules not processed for user `ebadf82546c5464ab21a467a50c70513`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:29.698188 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0376cb35-8edd-4c44-b3b5-0a780068814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:29.747512 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:37:29.789432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 665/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Jun 15 09:37:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:34.254215 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e37a4a-6589-43e5-b65a-da89c995ff62 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:34.254812 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e37a4a-6589-43e5-b65a-da89c995ff62 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:34.255474 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e37a4a-6589-43e5-b65a-da89c995ff62 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:34.256938 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 687/1352] 10.222.0.45 () {54 vars in 921 bytes} [Wed Jun 15 09:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:34.262828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6369-01ee-4bf3-b180-7f281b5933e3 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:34.263312 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6369-01ee-4bf3-b180-7f281b5933e3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:34.263520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f6369-01ee-4bf3-b180-7f281b5933e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:34.283569 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-742f6369-01ee-4bf3-b180-7f281b5933e3 None None] MFA Rules not processed for user `ebadf82546c5464ab21a467a50c70513`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:34.284933 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-742f6369-01ee-4bf3-b180-7f281b5933e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:34.294130 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 666/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Jun 15 09:37:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:34.312895 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=60 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:37:36.435997 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e0eb0-e049-4147-8752-3d3cd4e6fe84 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:36.437139 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e0eb0-e049-4147-8752-3d3cd4e6fe84 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:36.437450 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e0eb0-e049-4147-8752-3d3cd4e6fe84 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:36.438870 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 688/1354] 10.222.0.45 () {54 vars in 921 bytes} [Wed Jun 15 09:37:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:36.444425 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491f305-de90-4abf-aa32-1c878d0161e5 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:36.444911 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491f305-de90-4abf-aa32-1c878d0161e5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:36.445106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491f305-de90-4abf-aa32-1c878d0161e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:36.464255 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2491f305-de90-4abf-aa32-1c878d0161e5 None None] MFA Rules not processed for user `ebadf82546c5464ab21a467a50c70513`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:36.465451 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2491f305-de90-4abf-aa32-1c878d0161e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:36.474630 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 667/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Wed Jun 15 09:37:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 09:37:40.097176 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027b978-cc4b-49a3-8513-9c191f16d6f4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:40.097176 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027b978-cc4b-49a3-8513-9c191f16d6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:40.097176 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027b978-cc4b-49a3-8513-9c191f16d6f4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:40.097176 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 689/1356] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:40.098407 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87e68d-f03b-41ac-803c-8929a4243cd2 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:40.099690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87e68d-f03b-41ac-803c-8929a4243cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:40.099690 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87e68d-f03b-41ac-803c-8929a4243cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:40.126160 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1f87e68d-f03b-41ac-803c-8929a4243cd2 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:40.128085 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1f87e68d-f03b-41ac-803c-8929a4243cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:40.136548 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 668/1357] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:40.213445 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c536bc-967a-40e7-b50d-1b6b15bfc898 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:40.214106 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c536bc-967a-40e7-b50d-1b6b15bfc898 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:40.215489 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c536bc-967a-40e7-b50d-1b6b15bfc898 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:40.225034 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 690/1358] 10.222.0.45 () {54 vars in 961 bytes} [Wed Jun 15 09:37:40 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:40.231299 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50983dd3-5a77-4fc7-b28e-c042297fd033 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:40.231844 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50983dd3-5a77-4fc7-b28e-c042297fd033 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:40.232289 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50983dd3-5a77-4fc7-b28e-c042297fd033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:40.301697 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-50983dd3-5a77-4fc7-b28e-c042297fd033 None None] MFA Rules not processed for user `26dbaf7292444c8f9a6d45bfaf96763f`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:40.302155 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-50983dd3-5a77-4fc7-b28e-c042297fd033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:40.411894 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 669/1359] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Jun 15 09:37:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:40.420582 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c536bc-967a-40e7-b50d-1b6b15bfc898 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:40.438617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c536bc-967a-40e7-b50d-1b6b15bfc898 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:40.445154 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32b828-e5b0-44c0-802b-7345d11a0140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:40.445909 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32b828-e5b0-44c0-802b-7345d11a0140 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:40.446275 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32b828-e5b0-44c0-802b-7345d11a0140 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:40.446888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32b828-e5b0-44c0-802b-7345d11a0140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:40.459382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32b828-e5b0-44c0-802b-7345d11a0140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:40.461913 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32b828-e5b0-44c0-802b-7345d11a0140 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:40.476563 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 691/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 09:37:42.910115 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8114f6-4d5b-4134-b3c4-837431f8f24a None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:42.911372 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8114f6-4d5b-4134-b3c4-837431f8f24a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:42.911672 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8114f6-4d5b-4134-b3c4-837431f8f24a None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:42.914258 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 670/1361] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:42.921546 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f76f32-63df-4378-ba44-1bd8240d921b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:42.922070 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f76f32-63df-4378-ba44-1bd8240d921b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:42.922191 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f76f32-63df-4378-ba44-1bd8240d921b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:42.942938 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-09f76f32-63df-4378-ba44-1bd8240d921b None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:42.944181 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-09f76f32-63df-4378-ba44-1bd8240d921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:42.952359 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 692/1362] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 09:37:42.998140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8114f6-4d5b-4134-b3c4-837431f8f24a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:43.013736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8114f6-4d5b-4134-b3c4-837431f8f24a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:43.019960 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e851c6-c8ff-48ca-aa18-2d4a50f8a18c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:43.020616 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e851c6-c8ff-48ca-aa18-2d4a50f8a18c service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:43.020902 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e851c6-c8ff-48ca-aa18-2d4a50f8a18c service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:43.021185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e851c6-c8ff-48ca-aa18-2d4a50f8a18c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:43.030532 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e851c6-c8ff-48ca-aa18-2d4a50f8a18c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:43.032087 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e851c6-c8ff-48ca-aa18-2d4a50f8a18c service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:43.043485 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 671/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 09:37:45.611542 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d905e53-e5a7-484d-8416-8cdc10bb3e1b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:45.612798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d905e53-e5a7-484d-8416-8cdc10bb3e1b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:45.613498 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d905e53-e5a7-484d-8416-8cdc10bb3e1b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:45.621072 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 693/1364] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:45.623939 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca9bae-3239-44ff-b1d3-6c25f9d90ccc None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:45.624692 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca9bae-3239-44ff-b1d3-6c25f9d90ccc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:45.625194 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca9bae-3239-44ff-b1d3-6c25f9d90ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:45.661912 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1cca9bae-3239-44ff-b1d3-6c25f9d90ccc None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:45.663914 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1cca9bae-3239-44ff-b1d3-6c25f9d90ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:45.677961 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 672/1365] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:45.723475 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fdc1d-a038-4be2-8d41-3391587a95a4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:45.723740 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fdc1d-a038-4be2-8d41-3391587a95a4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:45.724010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fdc1d-a038-4be2-8d41-3391587a95a4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:45.725438 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 694/1366] 10.222.0.45 () {54 vars in 961 bytes} [Wed Jun 15 09:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:37:45.732285 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13b8f2-baf0-4e9d-ad4c-903a39751d8f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:45.732726 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13b8f2-baf0-4e9d-ad4c-903a39751d8f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:45.733220 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13b8f2-baf0-4e9d-ad4c-903a39751d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:45.763118 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0f13b8f2-baf0-4e9d-ad4c-903a39751d8f None None] MFA Rules not processed for user `26dbaf7292444c8f9a6d45bfaf96763f`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:45.765104 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0f13b8f2-baf0-4e9d-ad4c-903a39751d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:45.780335 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 673/1367] 10.222.0.45 () {58 vars in 1058 bytes} [Wed Jun 15 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:45.789382 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fdc1d-a038-4be2-8d41-3391587a95a4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:45.818726 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fdc1d-a038-4be2-8d41-3391587a95a4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:45.824927 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815d16c-c66e-4474-b737-8112318210c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:45.825661 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815d16c-c66e-4474-b737-8112318210c4 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:45.826084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815d16c-c66e-4474-b737-8112318210c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:45.826528 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815d16c-c66e-4474-b737-8112318210c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:45.836298 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815d16c-c66e-4474-b737-8112318210c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:45.837900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815d16c-c66e-4474-b737-8112318210c4 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:45.848574 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 695/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:37:48.574047 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87521f49-ad7e-4cf0-816f-de9f017818db None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:48.574961 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87521f49-ad7e-4cf0-816f-de9f017818db None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:48.574961 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87521f49-ad7e-4cf0-816f-de9f017818db None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:48.575970 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 674/1369] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:37:48.583930 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa60117-c819-405e-a6e0-ac7e01227739 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:48.584689 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa60117-c819-405e-a6e0-ac7e01227739 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:48.584689 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa60117-c819-405e-a6e0-ac7e01227739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:48.612832 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bfa60117-c819-405e-a6e0-ac7e01227739 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:48.614572 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bfa60117-c819-405e-a6e0-ac7e01227739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:48.626664 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 696/1370] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:48.702392 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87521f49-ad7e-4cf0-816f-de9f017818db None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:48.720763 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87521f49-ad7e-4cf0-816f-de9f017818db None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:48.727605 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81ec09-381c-4f8a-beb8-3042939dd8c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:48.728272 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ec09-381c-4f8a-beb8-3042939dd8c8 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:48.728564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ec09-381c-4f8a-beb8-3042939dd8c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:48.728844 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ec09-381c-4f8a-beb8-3042939dd8c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:48.739598 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81ec09-381c-4f8a-beb8-3042939dd8c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:48.741215 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81ec09-381c-4f8a-beb8-3042939dd8c8 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:48.753329 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 675/1371] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:37:49.528983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733684a-bb70-436e-845f-41b9f0db600f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:49.529556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733684a-bb70-436e-845f-41b9f0db600f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:49.529845 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733684a-bb70-436e-845f-41b9f0db600f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:49.531314 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 697/1372] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:49.539446 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66115ec3-58d9-453c-b501-3b900e7b707b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:49.539868 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66115ec3-58d9-453c-b501-3b900e7b707b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:49.540294 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66115ec3-58d9-453c-b501-3b900e7b707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:49.561145 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-66115ec3-58d9-453c-b501-3b900e7b707b None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:49.562422 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-66115ec3-58d9-453c-b501-3b900e7b707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:49.573973 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 676/1373] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:50.038150 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8419a8d-c3b8-4b61-bdec-c6ef3b2966c2 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:50.038990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8419a8d-c3b8-4b61-bdec-c6ef3b2966c2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:50.039673 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8419a8d-c3b8-4b61-bdec-c6ef3b2966c2 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:50.042442 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 698/1374] 10.222.0.45 () {54 vars in 963 bytes} [Wed Jun 15 09:37:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:50.051328 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a449a71-492e-4873-9efa-85cc87432e6e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:50.052094 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a449a71-492e-4873-9efa-85cc87432e6e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:50.054758 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a449a71-492e-4873-9efa-85cc87432e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:50.112606 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:37:50.159983 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0a449a71-492e-4873-9efa-85cc87432e6e None None] MFA Rules not processed for user `303c1175b5d24b0d8a929c7905a4c17c`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:50.162601 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0a449a71-492e-4873-9efa-85cc87432e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:50.258992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 677/1375] 10.222.0.45 () {58 vars in 1060 bytes} [Wed Jun 15 09:37:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 09:37:50.272663 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8419a8d-c3b8-4b61-bdec-c6ef3b2966c2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:50.292551 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8419a8d-c3b8-4b61-bdec-c6ef3b2966c2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:50.299378 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d7d8c-e821-4f67-88dd-9857dee6236f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303c1175b5d24b0d8a929c7905a4c17c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:50.301039 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d7d8c-e821-4f67-88dd-9857dee6236f service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:50.301546 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d7d8c-e821-4f67-88dd-9857dee6236f service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:50.302077 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d7d8c-e821-4f67-88dd-9857dee6236f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:50.319822 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d7d8c-e821-4f67-88dd-9857dee6236f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:50.322663 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d7d8c-e821-4f67-88dd-9857dee6236f service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:50.341442 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 699/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 09:37:51.046303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604cae8-f67b-42ce-adb9-fbf3ac4048f1 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:51.046633 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604cae8-f67b-42ce-adb9-fbf3ac4048f1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:51.046928 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604cae8-f67b-42ce-adb9-fbf3ac4048f1 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:51.048385 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 678/1377] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:37:51.054591 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195192c-c198-421f-8621-0e59a8dd4e35 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:51.055736 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195192c-c198-421f-8621-0e59a8dd4e35 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:51.055736 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195192c-c198-421f-8621-0e59a8dd4e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:51.079801 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9195192c-c198-421f-8621-0e59a8dd4e35 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:51.081019 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9195192c-c198-421f-8621-0e59a8dd4e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:51.092238 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 700/1378] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 09:37:51.147256 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604cae8-f67b-42ce-adb9-fbf3ac4048f1 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:51.166804 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604cae8-f67b-42ce-adb9-fbf3ac4048f1 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:51.173211 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42a6d6-e46c-448c-9c95-cd43065ccd5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:51.173901 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42a6d6-e46c-448c-9c95-cd43065ccd5a service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:51.174192 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42a6d6-e46c-448c-9c95-cd43065ccd5a service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:51.174473 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42a6d6-e46c-448c-9c95-cd43065ccd5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:51.184959 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42a6d6-e46c-448c-9c95-cd43065ccd5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:51.186620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42a6d6-e46c-448c-9c95-cd43065ccd5a service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:51.200737 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 679/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:37:53.497984 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17a208-22bc-476c-8c08-f6b889b8a776 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:53.498854 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17a208-22bc-476c-8c08-f6b889b8a776 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:53.499030 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17a208-22bc-476c-8c08-f6b889b8a776 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:53.501151 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 701/1380] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:53.507621 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab226c94-13f0-4339-b094-e46df6913c7c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:53.508304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab226c94-13f0-4339-b094-e46df6913c7c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:53.508304 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab226c94-13f0-4339-b094-e46df6913c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:53.528927 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ab226c94-13f0-4339-b094-e46df6913c7c None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:53.530194 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ab226c94-13f0-4339-b094-e46df6913c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:53.538829 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 680/1381] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:53.590578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17a208-22bc-476c-8c08-f6b889b8a776 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:53.606872 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17a208-22bc-476c-8c08-f6b889b8a776 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:53.612578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf11e98-431e-4f95-838c-863c4fd231c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:53.613234 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf11e98-431e-4f95-838c-863c4fd231c1 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:53.613582 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf11e98-431e-4f95-838c-863c4fd231c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:53.613868 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf11e98-431e-4f95-838c-863c4fd231c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:53.623538 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf11e98-431e-4f95-838c-863c4fd231c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:53.625505 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf11e98-431e-4f95-838c-863c4fd231c1 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:53.649516 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 702/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:37:56.129702 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe409a-d6fe-454b-842f-fea26ba83517 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:56.130249 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe409a-d6fe-454b-842f-fea26ba83517 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:56.130249 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe409a-d6fe-454b-842f-fea26ba83517 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:56.131707 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 681/1383] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:56.137981 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3157a-c70b-406a-93b3-287177f83b85 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:56.138593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3157a-c70b-406a-93b3-287177f83b85 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:56.138593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3157a-c70b-406a-93b3-287177f83b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:56.158439 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7ef3157a-c70b-406a-93b3-287177f83b85 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:56.160257 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7ef3157a-c70b-406a-93b3-287177f83b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:56.170943 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 703/1384] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:56.213078 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe409a-d6fe-454b-842f-fea26ba83517 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:56.228562 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe409a-d6fe-454b-842f-fea26ba83517 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:56.236624 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ed46b-0f1f-4c55-88dd-b377ffe7c392 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:56.237620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ed46b-0f1f-4c55-88dd-b377ffe7c392 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:56.237915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ed46b-0f1f-4c55-88dd-b377ffe7c392 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:56.238180 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ed46b-0f1f-4c55-88dd-b377ffe7c392 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:56.248538 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ed46b-0f1f-4c55-88dd-b377ffe7c392 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:56.250535 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ed46b-0f1f-4c55-88dd-b377ffe7c392 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:56.261867 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 682/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:37:58.510089 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6e1d3-cbcc-4edb-9780-e0055c52dd34 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:58.510854 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6e1d3-cbcc-4edb-9780-e0055c52dd34 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:58.510854 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6e1d3-cbcc-4edb-9780-e0055c52dd34 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:58.514890 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 704/1386] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:37:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:37:58.519146 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d503e-0990-412e-aef7-70f16fa32fc1 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:58.519975 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d503e-0990-412e-aef7-70f16fa32fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:58.520415 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d503e-0990-412e-aef7-70f16fa32fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:58.539829 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a79d503e-0990-412e-aef7-70f16fa32fc1 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:37:58.541044 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a79d503e-0990-412e-aef7-70f16fa32fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:37:58.550847 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 683/1387] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:37:58.598701 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6e1d3-cbcc-4edb-9780-e0055c52dd34 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:37:58.627411 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6e1d3-cbcc-4edb-9780-e0055c52dd34 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:37:58.639279 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e1b9d-244a-4559-9f59-5989ce30b6d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:37:58.641281 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e1b9d-244a-4559-9f59-5989ce30b6d2 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:37:58.642112 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e1b9d-244a-4559-9f59-5989ce30b6d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:37:58.643008 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e1b9d-244a-4559-9f59-5989ce30b6d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:37:58.661807 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e1b9d-244a-4559-9f59-5989ce30b6d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:37:58.665344 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e1b9d-244a-4559-9f59-5989ce30b6d2 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:37:58.680339 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 705/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:01.037761 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23888d-1903-4cec-a2fe-03d88a2c42dd None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:01.038359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23888d-1903-4cec-a2fe-03d88a2c42dd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:01.038359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23888d-1903-4cec-a2fe-03d88a2c42dd None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:01.039726 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 684/1389] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:01.045654 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd83610-d0b7-4856-91e1-48867479f1b2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:01.046124 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd83610-d0b7-4856-91e1-48867479f1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:01.046351 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd83610-d0b7-4856-91e1-48867479f1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:01.064632 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-edd83610-d0b7-4856-91e1-48867479f1b2 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:01.065863 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-edd83610-d0b7-4856-91e1-48867479f1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:01.073977 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 706/1390] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 09:38:01.125595 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23888d-1903-4cec-a2fe-03d88a2c42dd None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:01.154548 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23888d-1903-4cec-a2fe-03d88a2c42dd None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:01.161758 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5d138-be07-40ff-b3c8-213d31152d0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:01.162608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5d138-be07-40ff-b3c8-213d31152d0a service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:01.163231 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5d138-be07-40ff-b3c8-213d31152d0a service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:01.163607 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5d138-be07-40ff-b3c8-213d31152d0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:01.176780 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5d138-be07-40ff-b3c8-213d31152d0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:01.178949 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5d138-be07-40ff-b3c8-213d31152d0a service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:01.193397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 685/1391] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:03.573478 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bdb1b-ba8b-4ded-a970-ac2677188244 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:03.574044 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bdb1b-ba8b-4ded-a970-ac2677188244 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:03.574195 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bdb1b-ba8b-4ded-a970-ac2677188244 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:03.576116 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 707/1392] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:38:03.582966 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69d3db-0999-4c41-9ad5-35ef674eb785 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:03.583630 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69d3db-0999-4c41-9ad5-35ef674eb785 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:03.583630 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69d3db-0999-4c41-9ad5-35ef674eb785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:03.614523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ca69d3db-0999-4c41-9ad5-35ef674eb785 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:03.615765 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ca69d3db-0999-4c41-9ad5-35ef674eb785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:03.624520 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 686/1393] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:03.676973 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bdb1b-ba8b-4ded-a970-ac2677188244 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:03.696509 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bdb1b-ba8b-4ded-a970-ac2677188244 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:03.707936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee07a0-707c-46bc-958e-02eff2e90a94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:03.708833 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee07a0-707c-46bc-958e-02eff2e90a94 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:03.709213 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee07a0-707c-46bc-958e-02eff2e90a94 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:03.709571 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee07a0-707c-46bc-958e-02eff2e90a94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:03.722410 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee07a0-707c-46bc-958e-02eff2e90a94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:03.724585 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee07a0-707c-46bc-958e-02eff2e90a94 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:03.738971 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 708/1394] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 09:38:06.023895 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec525d-9fa5-489e-9f90-2820475969fc None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:06.024491 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec525d-9fa5-489e-9f90-2820475969fc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:06.024876 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec525d-9fa5-489e-9f90-2820475969fc None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:06.027609 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 687/1395] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:38:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:06.034287 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98ec6f-010a-42a6-a2e8-9ec23835f8cb None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:06.035092 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98ec6f-010a-42a6-a2e8-9ec23835f8cb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:06.035092 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98ec6f-010a-42a6-a2e8-9ec23835f8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:06.041593 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=52 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:38:06.056700 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8e98ec6f-010a-42a6-a2e8-9ec23835f8cb None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:06.058038 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8e98ec6f-010a-42a6-a2e8-9ec23835f8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:06.066611 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 709/1396] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:06.118780 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec525d-9fa5-489e-9f90-2820475969fc None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:06.135124 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec525d-9fa5-489e-9f90-2820475969fc None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:06.144353 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31068f-c160-4f57-8d71-21ee7e553b95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:06.145103 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31068f-c160-4f57-8d71-21ee7e553b95 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:06.145448 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31068f-c160-4f57-8d71-21ee7e553b95 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:06.145792 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31068f-c160-4f57-8d71-21ee7e553b95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:06.155572 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31068f-c160-4f57-8d71-21ee7e553b95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:06.157780 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31068f-c160-4f57-8d71-21ee7e553b95 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:06.169049 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 688/1397] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:07.250358 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b956b6-5021-4bd6-a257-2d46df166ca2 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:07.251049 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b956b6-5021-4bd6-a257-2d46df166ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:07.251049 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b956b6-5021-4bd6-a257-2d46df166ca2 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:07.252363 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 710/1398] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:07.257991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5916087-989d-438c-9325-944e5c69ccd1 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:07.258638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5916087-989d-438c-9325-944e5c69ccd1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:07.258638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5916087-989d-438c-9325-944e5c69ccd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:07.278143 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f5916087-989d-438c-9325-944e5c69ccd1 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:07.279419 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f5916087-989d-438c-9325-944e5c69ccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:07.288802 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 689/1399] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:07.348741 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f265496-85e1-4a26-b447-1931e90df8f1 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:07.349250 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f265496-85e1-4a26-b447-1931e90df8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:07.349721 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f265496-85e1-4a26-b447-1931e90df8f1 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:07.352794 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 711/1400] 10.222.0.45 () {54 vars in 962 bytes} [Wed Jun 15 09:38:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:07.363113 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced82b7c-d0c8-4e3c-900e-5110fb50dad8 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:07.363770 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced82b7c-d0c8-4e3c-900e-5110fb50dad8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:07.364159 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced82b7c-d0c8-4e3c-900e-5110fb50dad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:07.427439 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ced82b7c-d0c8-4e3c-900e-5110fb50dad8 None None] MFA Rules not processed for user `e6608bed12f746b89527a80b05459e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:07.428991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ced82b7c-d0c8-4e3c-900e-5110fb50dad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:07.481875 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:38:07.504373 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 690/1401] 10.222.0.45 () {58 vars in 1059 bytes} [Wed Jun 15 09:38:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:07.513012 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f265496-85e1-4a26-b447-1931e90df8f1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:07.526173 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f265496-85e1-4a26-b447-1931e90df8f1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:07.530086 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418a62d-d67e-4c01-8703-2231fb5df3db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6608bed12f746b89527a80b05459e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:07.530798 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418a62d-d67e-4c01-8703-2231fb5df3db service glance] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:07.531091 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418a62d-d67e-4c01-8703-2231fb5df3db service glance] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:07.531373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418a62d-d67e-4c01-8703-2231fb5df3db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:07.543219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418a62d-d67e-4c01-8703-2231fb5df3db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:07.545188 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418a62d-d67e-4c01-8703-2231fb5df3db service glance] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:07.558461 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 712/1402] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:08.333981 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a04adf-85b6-4bc7-9918-abcfb68d72b2 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:08.334841 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a04adf-85b6-4bc7-9918-abcfb68d72b2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:08.334841 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a04adf-85b6-4bc7-9918-abcfb68d72b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:08.395131 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-23a04adf-85b6-4bc7-9918-abcfb68d72b2 None None] MFA Rules not processed for user `57632a25fe1f4b18b75e9774e87d8ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:08.396273 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-23a04adf-85b6-4bc7-9918-abcfb68d72b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:08.420615 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e666de-9f5c-4180-b5f2-002a720db748 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:08.421453 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e666de-9f5c-4180-b5f2-002a720db748 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:08.421635 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e666de-9f5c-4180-b5f2-002a720db748 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:08.423888 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 713/1403] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:38:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:38:08.431275 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4f58c-b765-4c7d-8c35-7b8c41799d80 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:08.431741 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4f58c-b765-4c7d-8c35-7b8c41799d80 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:08.432207 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4f58c-b765-4c7d-8c35-7b8c41799d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:08.454091 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bbd4f58c-b765-4c7d-8c35-7b8c41799d80 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:08.455409 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bbd4f58c-b765-4c7d-8c35-7b8c41799d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:08.463663 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 714/1404] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 09:38:08.472074 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 691/1405] 10.222.0.45 () {58 vars in 1009 bytes} [Wed Jun 15 09:38:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:08.511120 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4f58c-b765-4c7d-8c35-7b8c41799d80 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:08.524564 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661990dc-066c-4699-b8a1-46db395efde1 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:08.525087 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661990dc-066c-4699-b8a1-46db395efde1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:08.525513 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661990dc-066c-4699-b8a1-46db395efde1 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:08.527541 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 692/1406] 10.222.0.45 () {54 vars in 942 bytes} [Wed Jun 15 09:38:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:08.533067 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4f58c-b765-4c7d-8c35-7b8c41799d80 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:08.537574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dfabf-60d2-4a34-a3cf-ae5a052c4815 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:08.538047 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dfabf-60d2-4a34-a3cf-ae5a052c4815 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:08.538561 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dfabf-60d2-4a34-a3cf-ae5a052c4815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:08.541211 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c73ac-dd87-49c9-813d-9cfabc7d5a08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:08.541972 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c73ac-dd87-49c9-813d-9cfabc7d5a08 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:08.542348 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c73ac-dd87-49c9-813d-9cfabc7d5a08 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:08.542846 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c73ac-dd87-49c9-813d-9cfabc7d5a08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:08.556300 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c73ac-dd87-49c9-813d-9cfabc7d5a08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:08.557967 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c73ac-dd87-49c9-813d-9cfabc7d5a08 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:08.570287 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 715/1407] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:08.607228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2e6dfabf-60d2-4a34-a3cf-ae5a052c4815 None None] MFA Rules not processed for user `cdbfc031f967416e9a2c94bce3d28f66`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:08.608717 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2e6dfabf-60d2-4a34-a3cf-ae5a052c4815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:08.709876 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 693/1408] 10.222.0.45 () {58 vars in 1039 bytes} [Wed Jun 15 09:38:08 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:08.722406 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c73ac-dd87-49c9-813d-9cfabc7d5a08 service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:08.734067 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c73ac-dd87-49c9-813d-9cfabc7d5a08 service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:08.740001 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81a9a7-c2d2-4907-b12f-55a91e014da1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdbfc031f967416e9a2c94bce3d28f66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:08.740696 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81a9a7-c2d2-4907-b12f-55a91e014da1 service swift] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:08.740983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81a9a7-c2d2-4907-b12f-55a91e014da1 service swift] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:08.741270 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81a9a7-c2d2-4907-b12f-55a91e014da1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:08.751153 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81a9a7-c2d2-4907-b12f-55a91e014da1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:08.752791 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81a9a7-c2d2-4907-b12f-55a91e014da1 service swift] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:08.762179 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 716/1409] 10.222.0.45 () {60 vars in 1384 bytes} [Wed Jun 15 09:38:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 09:38:18.707212 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=89 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:38:18.758489 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=23 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:38:31.984932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b90533-8a2f-415a-a3b7-12cfd0528772 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:31.985578 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b90533-8a2f-415a-a3b7-12cfd0528772 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:31.985578 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b90533-8a2f-415a-a3b7-12cfd0528772 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:31.986885 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 694/1410] 10.222.0.45 () {54 vars in 918 bytes} [Wed Jun 15 09:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:31.995953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e74a6d-5ee9-4b8b-b1cb-75dfed2a08c3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:31.996521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e74a6d-5ee9-4b8b-b1cb-75dfed2a08c3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:31.996521 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e74a6d-5ee9-4b8b-b1cb-75dfed2a08c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:32.018000 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a9e74a6d-5ee9-4b8b-b1cb-75dfed2a08c3 None None] MFA Rules not processed for user `ebadf82546c5464ab21a467a50c70513`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:32.019246 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a9e74a6d-5ee9-4b8b-b1cb-75dfed2a08c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:32.028845 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 717/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Jun 15 09:38:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:32.043244 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b2213-045a-4cce-ab24-5bd17b05ef10 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:32.043559 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b2213-045a-4cce-ab24-5bd17b05ef10 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:32.043852 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b2213-045a-4cce-ab24-5bd17b05ef10 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:32.045200 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 695/1412] 10.222.0.45 () {54 vars in 918 bytes} [Wed Jun 15 09:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:32.050346 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c06c3d-0f86-4fc8-a569-7fbcbfbce731 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:32.050674 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c06c3d-0f86-4fc8-a569-7fbcbfbce731 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:32.050959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c06c3d-0f86-4fc8-a569-7fbcbfbce731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:32.069719 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-01c06c3d-0f86-4fc8-a569-7fbcbfbce731 None None] MFA Rules not processed for user `26dbaf7292444c8f9a6d45bfaf96763f`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:32.070983 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-01c06c3d-0f86-4fc8-a569-7fbcbfbce731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:32.080699 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 718/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Jun 15 09:38:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 09:38:34.831847 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab9b56-3ff8-46b5-8fd9-6944359843a8 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:34.832433 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab9b56-3ff8-46b5-8fd9-6944359843a8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:34.832433 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab9b56-3ff8-46b5-8fd9-6944359843a8 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:34.833730 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 696/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 09:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:34.839874 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95ce99-3d76-4c44-a85d-98b3764e3fb1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:34.843547 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95ce99-3d76-4c44-a85d-98b3764e3fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:34.843547 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95ce99-3d76-4c44-a85d-98b3764e3fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:34.858995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bb95ce99-3d76-4c44-a85d-98b3764e3fb1 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:34.860219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bb95ce99-3d76-4c44-a85d-98b3764e3fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:34.868180 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 719/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 09:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:34.912373 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab9b56-3ff8-46b5-8fd9-6944359843a8 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:34.928921 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab9b56-3ff8-46b5-8fd9-6944359843a8 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:34.934642 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d02d0e-4cc9-4b55-8d8f-3dba77d53f99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:34.935298 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d02d0e-4cc9-4b55-8d8f-3dba77d53f99 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:34.935589 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d02d0e-4cc9-4b55-8d8f-3dba77d53f99 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:34.935873 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d02d0e-4cc9-4b55-8d8f-3dba77d53f99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:34.944698 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d02d0e-4cc9-4b55-8d8f-3dba77d53f99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:34.946293 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d02d0e-4cc9-4b55-8d8f-3dba77d53f99 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:34.956228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 697/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:35.925210 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14242127-0d55-4492-86c3-60393802b7a4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:35.925796 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14242127-0d55-4492-86c3-60393802b7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:35.925796 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14242127-0d55-4492-86c3-60393802b7a4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:35.927164 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 720/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 09:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:35.932758 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce45c7a-6dd6-43d4-a5e3-3b37f4102b60 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:35.933259 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce45c7a-6dd6-43d4-a5e3-3b37f4102b60 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:35.933416 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce45c7a-6dd6-43d4-a5e3-3b37f4102b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:35.952109 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-cce45c7a-6dd6-43d4-a5e3-3b37f4102b60 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:35.953336 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-cce45c7a-6dd6-43d4-a5e3-3b37f4102b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:35.961544 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 698/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 09:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:36.128833 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14242127-0d55-4492-86c3-60393802b7a4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:36.154776 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14242127-0d55-4492-86c3-60393802b7a4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:36.160688 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdbb63-8f44-4d59-924c-c4a35055cbc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:36.161349 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdbb63-8f44-4d59-924c-c4a35055cbc0 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:36.161631 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdbb63-8f44-4d59-924c-c4a35055cbc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:36.161911 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdbb63-8f44-4d59-924c-c4a35055cbc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:36.171607 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdbb63-8f44-4d59-924c-c4a35055cbc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:36.173194 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdbb63-8f44-4d59-924c-c4a35055cbc0 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:36.183489 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 721/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:37.122228 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b6b38-003e-47ac-a503-7e74a7c3bebf None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:37.122938 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b6b38-003e-47ac-a503-7e74a7c3bebf None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:37.122938 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b6b38-003e-47ac-a503-7e74a7c3bebf None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:37.124211 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 699/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 09:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:37.129148 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d4d32-fd5e-46ff-82ac-bfbf62cd6267 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:37.129630 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d4d32-fd5e-46ff-82ac-bfbf62cd6267 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:37.129718 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d4d32-fd5e-46ff-82ac-bfbf62cd6267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:37.151648 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-bd3d4d32-fd5e-46ff-82ac-bfbf62cd6267 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:37.152871 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-bd3d4d32-fd5e-46ff-82ac-bfbf62cd6267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:37.160699 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 722/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 09:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:37.315460 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b6b38-003e-47ac-a503-7e74a7c3bebf None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:37.330932 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b6b38-003e-47ac-a503-7e74a7c3bebf None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:37.336313 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adb2de-aa95-42e6-b98e-33fd2b546d52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:37.336965 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adb2de-aa95-42e6-b98e-33fd2b546d52 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:37.337247 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adb2de-aa95-42e6-b98e-33fd2b546d52 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:37.337527 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adb2de-aa95-42e6-b98e-33fd2b546d52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:37.347236 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adb2de-aa95-42e6-b98e-33fd2b546d52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:37.348850 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adb2de-aa95-42e6-b98e-33fd2b546d52 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:37.361837 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 700/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:38.300137 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c66d6f-e90c-4eeb-b179-2688527d35f0 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:38.300721 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c66d6f-e90c-4eeb-b179-2688527d35f0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:38.300721 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c66d6f-e90c-4eeb-b179-2688527d35f0 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:38.302109 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 723/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 09:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:38.307712 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a894c3-ebd9-4261-aac2-14052b03bc6b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:38.308490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a894c3-ebd9-4261-aac2-14052b03bc6b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:38.308490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a894c3-ebd9-4261-aac2-14052b03bc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:38.329154 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-50a894c3-ebd9-4261-aac2-14052b03bc6b None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:38.330410 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-50a894c3-ebd9-4261-aac2-14052b03bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:38.338651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 701/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 09:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:38.498874 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c66d6f-e90c-4eeb-b179-2688527d35f0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:38.514302 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c66d6f-e90c-4eeb-b179-2688527d35f0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:38.519762 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827837f-63e4-4e96-a803-6fa7cd8a0f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:38.520415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827837f-63e4-4e96-a803-6fa7cd8a0f4a service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:38.520707 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827837f-63e4-4e96-a803-6fa7cd8a0f4a service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:38.520990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827837f-63e4-4e96-a803-6fa7cd8a0f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:38.530110 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827837f-63e4-4e96-a803-6fa7cd8a0f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:38.531782 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827837f-63e4-4e96-a803-6fa7cd8a0f4a service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:38.541304 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 724/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 09:38:39.460076 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672eb1a-27f0-42ee-8b6f-ca434852edca None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:39.460762 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672eb1a-27f0-42ee-8b6f-ca434852edca None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:39.460762 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672eb1a-27f0-42ee-8b6f-ca434852edca None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:39.462005 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 702/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 09:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:38:39.467948 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa91fb1-64d9-4f7f-a82e-7a52c75e5d7a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:39.468463 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa91fb1-64d9-4f7f-a82e-7a52c75e5d7a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:39.468558 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa91fb1-64d9-4f7f-a82e-7a52c75e5d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:39.487613 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-efa91fb1-64d9-4f7f-a82e-7a52c75e5d7a None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:39.488814 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-efa91fb1-64d9-4f7f-a82e-7a52c75e5d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:39.497008 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 725/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 09:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:39.647087 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672eb1a-27f0-42ee-8b6f-ca434852edca None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:39.661992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672eb1a-27f0-42ee-8b6f-ca434852edca None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:39.667405 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abec239-0c6f-4776-aece-26da4e1b7238 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:39.668076 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abec239-0c6f-4776-aece-26da4e1b7238 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:39.668357 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abec239-0c6f-4776-aece-26da4e1b7238 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:39.668631 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abec239-0c6f-4776-aece-26da4e1b7238 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:39.677103 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abec239-0c6f-4776-aece-26da4e1b7238 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:39.678745 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abec239-0c6f-4776-aece-26da4e1b7238 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:39.688639 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 703/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:40.561094 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf5d76-96f7-4a68-a0d5-b8341f9a98ed None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:40.561614 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf5d76-96f7-4a68-a0d5-b8341f9a98ed None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:40.561712 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf5d76-96f7-4a68-a0d5-b8341f9a98ed None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:40.563096 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 726/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 09:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:40.570314 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfcf11-dfb5-4406-8469-d330e7061fd5 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:40.570815 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfcf11-dfb5-4406-8469-d330e7061fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:40.570908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfcf11-dfb5-4406-8469-d330e7061fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:40.588651 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-cbdfcf11-dfb5-4406-8469-d330e7061fd5 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:40.589858 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-cbdfcf11-dfb5-4406-8469-d330e7061fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:40.597761 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 704/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 09:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 09:38:40.753812 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf5d76-96f7-4a68-a0d5-b8341f9a98ed None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:40.769953 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf5d76-96f7-4a68-a0d5-b8341f9a98ed None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:40.776107 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3685622-b8b4-4b4b-bcdb-4613e10a4a02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:40.776758 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3685622-b8b4-4b4b-bcdb-4613e10a4a02 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:40.777049 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3685622-b8b4-4b4b-bcdb-4613e10a4a02 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:40.777580 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3685622-b8b4-4b4b-bcdb-4613e10a4a02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:40.788718 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3685622-b8b4-4b4b-bcdb-4613e10a4a02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:40.790370 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3685622-b8b4-4b4b-bcdb-4613e10a4a02 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:40.801515 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 727/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:41.675355 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10aaba4-31e4-4960-a8c9-17868283b9bd None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:41.675960 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10aaba4-31e4-4960-a8c9-17868283b9bd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:41.675960 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10aaba4-31e4-4960-a8c9-17868283b9bd None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:41.677270 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 705/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 09:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:41.682268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35876e-4b4e-4053-adef-1469756831d3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:41.682731 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35876e-4b4e-4053-adef-1469756831d3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:41.682858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35876e-4b4e-4053-adef-1469756831d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:41.702592 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4d35876e-4b4e-4053-adef-1469756831d3 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:41.703802 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4d35876e-4b4e-4053-adef-1469756831d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:41.711537 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 728/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 09:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:41.864514 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10aaba4-31e4-4960-a8c9-17868283b9bd None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:41.879551 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10aaba4-31e4-4960-a8c9-17868283b9bd None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:41.884870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe769cc-8795-4f45-a77c-b1048bfa44ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:41.885547 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe769cc-8795-4f45-a77c-b1048bfa44ed service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:41.885830 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe769cc-8795-4f45-a77c-b1048bfa44ed service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:41.886107 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe769cc-8795-4f45-a77c-b1048bfa44ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:41.894834 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe769cc-8795-4f45-a77c-b1048bfa44ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:41.896475 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe769cc-8795-4f45-a77c-b1048bfa44ed service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:41.907266 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 706/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:42.775803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92df923-24d6-4f8b-8728-2ff1e1fa3ba1 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:42.776373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92df923-24d6-4f8b-8728-2ff1e1fa3ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:42.776373 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92df923-24d6-4f8b-8728-2ff1e1fa3ba1 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:42.777739 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 729/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 09:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:42.783810 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38dda0-81f1-4c70-96e3-451c1f36a6ca None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:42.784236 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38dda0-81f1-4c70-96e3-451c1f36a6ca None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:42.784412 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38dda0-81f1-4c70-96e3-451c1f36a6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:42.803140 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-df38dda0-81f1-4c70-96e3-451c1f36a6ca None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:42.804287 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-df38dda0-81f1-4c70-96e3-451c1f36a6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:42.812154 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 707/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 09:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:42.965716 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92df923-24d6-4f8b-8728-2ff1e1fa3ba1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:42.981804 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92df923-24d6-4f8b-8728-2ff1e1fa3ba1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:42.987580 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20777435-6826-4080-aa0b-706e1183f5e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:42.988222 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20777435-6826-4080-aa0b-706e1183f5e9 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:42.988503 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20777435-6826-4080-aa0b-706e1183f5e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:42.988777 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20777435-6826-4080-aa0b-706e1183f5e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:42.997513 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20777435-6826-4080-aa0b-706e1183f5e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:42.999617 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20777435-6826-4080-aa0b-706e1183f5e9 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:43.009233 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 730/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:43.887424 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9db79-327e-4056-a87c-c160a2e8c7ec None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:43.887945 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9db79-327e-4056-a87c-c160a2e8c7ec None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:43.888036 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9db79-327e-4056-a87c-c160a2e8c7ec None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:43.889525 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 708/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 09:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:43.894742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006c375-8ca9-4e6c-a5c9-be43df41b6bc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:43.895200 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006c375-8ca9-4e6c-a5c9-be43df41b6bc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:43.895311 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006c375-8ca9-4e6c-a5c9-be43df41b6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:43.913974 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c006c375-8ca9-4e6c-a5c9-be43df41b6bc None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:43.915219 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c006c375-8ca9-4e6c-a5c9-be43df41b6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:43.923744 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 731/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 09:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:44.074009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9db79-327e-4056-a87c-c160a2e8c7ec None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:44.089045 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9db79-327e-4056-a87c-c160a2e8c7ec None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:44.095208 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346f7a1-c288-4953-ab93-87ca0b9e8bb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:44.095854 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346f7a1-c288-4953-ab93-87ca0b9e8bb6 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:44.096134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346f7a1-c288-4953-ab93-87ca0b9e8bb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:44.096406 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346f7a1-c288-4953-ab93-87ca0b9e8bb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:44.107490 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346f7a1-c288-4953-ab93-87ca0b9e8bb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:44.108927 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346f7a1-c288-4953-ab93-87ca0b9e8bb6 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:44.119393 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 709/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:46.161032 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ecdbf-9921-4187-80c0-03e3c9582a42 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:46.161598 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ecdbf-9921-4187-80c0-03e3c9582a42 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:46.161598 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ecdbf-9921-4187-80c0-03e3c9582a42 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:46.163033 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 732/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 09:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:46.168912 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4293c-292f-43fd-82c6-db96fb5a0065 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:46.169374 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4293c-292f-43fd-82c6-db96fb5a0065 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:46.169487 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4293c-292f-43fd-82c6-db96fb5a0065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:46.188494 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-16c4293c-292f-43fd-82c6-db96fb5a0065 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:46.189704 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-16c4293c-292f-43fd-82c6-db96fb5a0065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:46.197620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 710/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 09:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 09:38:46.236722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ecdbf-9921-4187-80c0-03e3c9582a42 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:46.247623 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ecdbf-9921-4187-80c0-03e3c9582a42 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:46.251753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37695e31-77bf-4b7c-b348-489ce984cf3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:46.252396 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37695e31-77bf-4b7c-b348-489ce984cf3d service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:46.252684 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37695e31-77bf-4b7c-b348-489ce984cf3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:46.252959 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37695e31-77bf-4b7c-b348-489ce984cf3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:46.262047 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37695e31-77bf-4b7c-b348-489ce984cf3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:46.263494 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37695e31-77bf-4b7c-b348-489ce984cf3d service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:46.272779 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 733/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:48.537480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f72407-603f-4bed-b9bb-dd68065126f7 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:48.538045 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f72407-603f-4bed-b9bb-dd68065126f7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:48.538045 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f72407-603f-4bed-b9bb-dd68065126f7 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:48.539432 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 711/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 09:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:48.544750 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9c3b3-d988-40fd-88ab-cd3ab5f2c49f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:48.545208 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9c3b3-d988-40fd-88ab-cd3ab5f2c49f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:48.545323 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9c3b3-d988-40fd-88ab-cd3ab5f2c49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:48.562699 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0ec9c3b3-d988-40fd-88ab-cd3ab5f2c49f None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:48.563892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0ec9c3b3-d988-40fd-88ab-cd3ab5f2c49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:48.571588 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 734/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:48.609395 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f72407-603f-4bed-b9bb-dd68065126f7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:48.620700 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f72407-603f-4bed-b9bb-dd68065126f7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:48.624337 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083052-3fee-4c01-ad54-ae4781022428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:48.625073 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083052-3fee-4c01-ad54-ae4781022428 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:48.625362 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083052-3fee-4c01-ad54-ae4781022428 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:48.625640 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083052-3fee-4c01-ad54-ae4781022428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:48.635714 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36083052-3fee-4c01-ad54-ae4781022428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:48.637185 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36083052-3fee-4c01-ad54-ae4781022428 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:48.648484 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 712/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:51.188708 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721570a-783e-4e0d-853c-40f3267d687e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:51.189287 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721570a-783e-4e0d-853c-40f3267d687e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:51.189287 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721570a-783e-4e0d-853c-40f3267d687e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:51.190686 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 735/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 09:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:51.196292 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe47a8-ada9-4345-a193-2b4b25d5e335 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:51.197054 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe47a8-ada9-4345-a193-2b4b25d5e335 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:51.197260 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe47a8-ada9-4345-a193-2b4b25d5e335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:51.216038 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-77fe47a8-ada9-4345-a193-2b4b25d5e335 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:51.216627 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-77fe47a8-ada9-4345-a193-2b4b25d5e335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:51.225105 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 713/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 09:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:51.263360 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721570a-783e-4e0d-853c-40f3267d687e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:51.273949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721570a-783e-4e0d-853c-40f3267d687e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:51.277434 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b18b2-f01b-418e-a501-b71a500870a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:51.278076 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b18b2-f01b-418e-a501-b71a500870a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:51.278357 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b18b2-f01b-418e-a501-b71a500870a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:51.278667 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b18b2-f01b-418e-a501-b71a500870a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:51.288878 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b18b2-f01b-418e-a501-b71a500870a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:51.290315 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b18b2-f01b-418e-a501-b71a500870a0 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:51.300415 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 736/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:53.570359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c71deb-3a35-41dd-9477-3cbeea0e4f93 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:53.570908 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c71deb-3a35-41dd-9477-3cbeea0e4f93 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:53.571001 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c71deb-3a35-41dd-9477-3cbeea0e4f93 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:53.572440 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 714/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 09:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:53.577979 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf160a-c3b0-4703-ac1b-7ac1538be910 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:53.578410 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf160a-c3b0-4703-ac1b-7ac1538be910 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:53.578569 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf160a-c3b0-4703-ac1b-7ac1538be910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:53.596735 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-51bf160a-c3b0-4703-ac1b-7ac1538be910 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:53.597958 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-51bf160a-c3b0-4703-ac1b-7ac1538be910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:53.606020 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 737/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 09:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:53.645819 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c71deb-3a35-41dd-9477-3cbeea0e4f93 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:53.647540 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-32c71deb-3a35-41dd-9477-3cbeea0e4f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:53.660723 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c71deb-3a35-41dd-9477-3cbeea0e4f93 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:53.664513 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1bbfe-7d34-447f-b5b5-2a3c43a6eb5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:53.665072 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1bbfe-7d34-447f-b5b5-2a3c43a6eb5a service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:53.665359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1bbfe-7d34-447f-b5b5-2a3c43a6eb5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:53.665638 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1bbfe-7d34-447f-b5b5-2a3c43a6eb5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:53.675009 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1bbfe-7d34-447f-b5b5-2a3c43a6eb5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:53.676436 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1bbfe-7d34-447f-b5b5-2a3c43a6eb5a service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:53.686045 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 715/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:55.952632 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360248b-53dd-4c28-8c2f-261f70cb4d99 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:55.953160 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360248b-53dd-4c28-8c2f-261f70cb4d99 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:55.953160 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360248b-53dd-4c28-8c2f-261f70cb4d99 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:55.954485 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 738/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 09:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:55.959747 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219068-4c6b-4b60-b7b2-880dc4ef7c3c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:55.960171 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219068-4c6b-4b60-b7b2-880dc4ef7c3c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:55.960345 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219068-4c6b-4b60-b7b2-880dc4ef7c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:55.978828 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1d219068-4c6b-4b60-b7b2-880dc4ef7c3c None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:55.980046 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1d219068-4c6b-4b60-b7b2-880dc4ef7c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:55.988409 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 716/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 09:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:56.026751 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360248b-53dd-4c28-8c2f-261f70cb4d99 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:56.038338 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360248b-53dd-4c28-8c2f-261f70cb4d99 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:56.041824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d75f00-0a3e-42b4-a92d-176dcd7bd7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:56.042452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d75f00-0a3e-42b4-a92d-176dcd7bd7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:56.042778 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d75f00-0a3e-42b4-a92d-176dcd7bd7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:56.043053 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d75f00-0a3e-42b4-a92d-176dcd7bd7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:56.051890 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d75f00-0a3e-42b4-a92d-176dcd7bd7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:56.053307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d75f00-0a3e-42b4-a92d-176dcd7bd7d5 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:56.062708 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 739/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:38:58.249642 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d59d8-17ef-49d4-959d-2df3f86d5709 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:58.250302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d59d8-17ef-49d4-959d-2df3f86d5709 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:58.250302 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d59d8-17ef-49d4-959d-2df3f86d5709 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:58.251608 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 717/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 09:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:38:58.257550 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ba2b2-e825-4c5f-b32a-b992a7c1fa12 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:58.258010 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ba2b2-e825-4c5f-b32a-b992a7c1fa12 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:58.258123 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ba2b2-e825-4c5f-b32a-b992a7c1fa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:58.276321 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9e7ba2b2-e825-4c5f-b32a-b992a7c1fa12 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:38:58.278048 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9e7ba2b2-e825-4c5f-b32a-b992a7c1fa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:38:58.285696 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 740/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 09:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:38:58.324455 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d59d8-17ef-49d4-959d-2df3f86d5709 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:38:58.335336 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d59d8-17ef-49d4-959d-2df3f86d5709 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:38:58.346797 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8eb01-1b5d-44a0-9ad5-a3a63c6a6abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:38:58.347464 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8eb01-1b5d-44a0-9ad5-a3a63c6a6abd service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:38:58.347777 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8eb01-1b5d-44a0-9ad5-a3a63c6a6abd service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:38:58.348055 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8eb01-1b5d-44a0-9ad5-a3a63c6a6abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:38:58.357891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8eb01-1b5d-44a0-9ad5-a3a63c6a6abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:38:58.359378 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8eb01-1b5d-44a0-9ad5-a3a63c6a6abd service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:38:58.370305 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 718/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:39:00.558513 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09497444-5575-4bca-8f8e-7cc91c95cc35 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:00.559028 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09497444-5575-4bca-8f8e-7cc91c95cc35 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:00.559227 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09497444-5575-4bca-8f8e-7cc91c95cc35 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:00.560559 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 741/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 09:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:39:00.566266 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7959f45-25d3-4201-9cdf-5986dde41131 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:00.566748 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7959f45-25d3-4201-9cdf-5986dde41131 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:00.566864 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7959f45-25d3-4201-9cdf-5986dde41131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:00.573296 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=70 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:39:00.587759 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b7959f45-25d3-4201-9cdf-5986dde41131 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:39:00.588991 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b7959f45-25d3-4201-9cdf-5986dde41131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:39:00.596868 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 719/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 09:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:39:00.634116 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09497444-5575-4bca-8f8e-7cc91c95cc35 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:39:00.639452 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=73 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:39:00.646925 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09497444-5575-4bca-8f8e-7cc91c95cc35 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:39:00.650347 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db43c5-be25-467d-8e7a-41dcd79a40d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:39:00.651021 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db43c5-be25-467d-8e7a-41dcd79a40d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:00.651390 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db43c5-be25-467d-8e7a-41dcd79a40d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:00.651578 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db43c5-be25-467d-8e7a-41dcd79a40d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:00.661388 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db43c5-be25-467d-8e7a-41dcd79a40d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:39:00.662858 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db43c5-be25-467d-8e7a-41dcd79a40d9 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:39:00.672119 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 742/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:39:02.937655 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684d975-445d-47c9-9e69-d19a878cc822 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:02.938166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684d975-445d-47c9-9e69-d19a878cc822 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:02.938166 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684d975-445d-47c9-9e69-d19a878cc822 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:02.939550 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 720/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 09:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:39:02.944966 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a41df-63f7-4b7b-a157-abf9a33e329e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:02.945456 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a41df-63f7-4b7b-a157-abf9a33e329e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:02.945564 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a41df-63f7-4b7b-a157-abf9a33e329e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:02.964660 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ec2a41df-63f7-4b7b-a157-abf9a33e329e None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:39:02.965892 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ec2a41df-63f7-4b7b-a157-abf9a33e329e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:39:02.974547 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 743/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 09:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:39:03.011235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684d975-445d-47c9-9e69-d19a878cc822 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:39:03.022590 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684d975-445d-47c9-9e69-d19a878cc822 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:39:03.026083 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab139b-34af-4664-b553-53f0c151350d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:39:03.026821 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab139b-34af-4664-b553-53f0c151350d service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:03.027109 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab139b-34af-4664-b553-53f0c151350d service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:03.027380 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab139b-34af-4664-b553-53f0c151350d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:03.037910 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab139b-34af-4664-b553-53f0c151350d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:39:03.039369 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab139b-34af-4664-b553-53f0c151350d service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:39:03.049075 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 721/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:39:05.198620 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b420-5bf5-415c-83f5-3730aa2dc779 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:05.199164 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b420-5bf5-415c-83f5-3730aa2dc779 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:05.199164 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b420-5bf5-415c-83f5-3730aa2dc779 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:05.200586 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 744/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 09:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:39:05.205976 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6a366-a046-421c-8a88-493467b56ffd None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:05.206468 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6a366-a046-421c-8a88-493467b56ffd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:05.206583 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6a366-a046-421c-8a88-493467b56ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:05.226437 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-19e6a366-a046-421c-8a88-493467b56ffd None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:39:05.227717 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-19e6a366-a046-421c-8a88-493467b56ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:39:05.235864 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 722/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 09:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:39:05.272347 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871b420-5bf5-415c-83f5-3730aa2dc779 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:39:05.283084 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871b420-5bf5-415c-83f5-3730aa2dc779 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:39:05.287435 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135104ce-72fe-4cf5-9d89-ac3265883b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:39:05.288082 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135104ce-72fe-4cf5-9d89-ac3265883b5e service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:05.288366 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135104ce-72fe-4cf5-9d89-ac3265883b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:05.288644 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135104ce-72fe-4cf5-9d89-ac3265883b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:05.298056 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135104ce-72fe-4cf5-9d89-ac3265883b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:39:05.299529 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135104ce-72fe-4cf5-9d89-ac3265883b5e service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:39:05.309827 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 745/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:39:07.478171 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720377b8-eee0-44e4-9ee9-424ca33cc946 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:07.478768 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720377b8-eee0-44e4-9ee9-424ca33cc946 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:07.478768 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720377b8-eee0-44e4-9ee9-424ca33cc946 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:07.480121 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 723/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 09:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:39:07.485494 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5488303-eae2-4655-a687-97fc5ac80641 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:07.485907 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5488303-eae2-4655-a687-97fc5ac80641 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:07.486067 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5488303-eae2-4655-a687-97fc5ac80641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:07.504057 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e5488303-eae2-4655-a687-97fc5ac80641 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:39:07.505268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e5488303-eae2-4655-a687-97fc5ac80641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:39:07.513862 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 746/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 09:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:39:07.550748 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720377b8-eee0-44e4-9ee9-424ca33cc946 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:39:07.562123 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720377b8-eee0-44e4-9ee9-424ca33cc946 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:39:07.565659 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a0e9c-06e1-4489-bfc7-84628489610e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:39:07.566303 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a0e9c-06e1-4489-bfc7-84628489610e service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:07.566625 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a0e9c-06e1-4489-bfc7-84628489610e service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:07.566906 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a0e9c-06e1-4489-bfc7-84628489610e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:07.576649 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a0e9c-06e1-4489-bfc7-84628489610e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:39:07.578069 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a0e9c-06e1-4489-bfc7-84628489610e service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:39:07.587594 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 724/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:39:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:39:17.498947 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=17 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:39:17.583349 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=17 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:39:27.676764 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c7263-ef89-4b78-ab41-92120fcbb9d4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:27.677349 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c7263-ef89-4b78-ab41-92120fcbb9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:27.677437 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c7263-ef89-4b78-ab41-92120fcbb9d4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:27.678875 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 747/1471] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:39:27.684555 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab2843-6788-4a25-b0f5-54f17a172ee2 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:27.684992 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab2843-6788-4a25-b0f5-54f17a172ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:27.685123 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab2843-6788-4a25-b0f5-54f17a172ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:27.703439 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b4ab2843-6788-4a25-b0f5-54f17a172ee2 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:39:27.704677 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b4ab2843-6788-4a25-b0f5-54f17a172ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:39:27.712491 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 725/1472] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:39:27.759490 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11c001-908c-4ce5-93c5-a82df48bb427 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:27.759781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11c001-908c-4ce5-93c5-a82df48bb427 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:27.760061 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11c001-908c-4ce5-93c5-a82df48bb427 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:27.762143 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 748/1473] 10.222.0.45 () {54 vars in 962 bytes} [Wed Jun 15 09:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:39:27.767337 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f5e08-1358-4341-8624-37136aab3697 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:27.768181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f5e08-1358-4341-8624-37136aab3697 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:27.768181 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f5e08-1358-4341-8624-37136aab3697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:27.786079 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-578f5e08-1358-4341-8624-37136aab3697 None None] MFA Rules not processed for user `e6608bed12f746b89527a80b05459e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:39:27.787338 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-578f5e08-1358-4341-8624-37136aab3697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:39:27.794202 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 726/1474] 10.222.0.45 () {58 vars in 1059 bytes} [Wed Jun 15 09:39:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:39:27.801657 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11c001-908c-4ce5-93c5-a82df48bb427 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:39:27.813334 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11c001-908c-4ce5-93c5-a82df48bb427 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:39:27.816890 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bd43c-2e7c-4031-8b60-c4a16666b484 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6608bed12f746b89527a80b05459e5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:39:27.817523 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bd43c-2e7c-4031-8b60-c4a16666b484 service glance] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:27.817803 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bd43c-2e7c-4031-8b60-c4a16666b484 service glance] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:27.818077 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bd43c-2e7c-4031-8b60-c4a16666b484 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:27.827992 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bd43c-2e7c-4031-8b60-c4a16666b484 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:39:27.829413 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bd43c-2e7c-4031-8b60-c4a16666b484 service glance] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:39:27.839218 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 749/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:39:30.093721 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63270c4-82f2-4c82-9192-baa55015805b None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:30.094291 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63270c4-82f2-4c82-9192-baa55015805b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:30.094291 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63270c4-82f2-4c82-9192-baa55015805b None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:30.095655 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 727/1476] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:39:30.101058 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fc75d-81e1-44cf-9d74-e212e110d6f7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:30.101520 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fc75d-81e1-44cf-9d74-e212e110d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:30.101649 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fc75d-81e1-44cf-9d74-e212e110d6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:30.119480 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-017fc75d-81e1-44cf-9d74-e212e110d6f7 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:39:30.121175 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-017fc75d-81e1-44cf-9d74-e212e110d6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:39:30.129228 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 750/1477] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:39:30.153212 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63270c4-82f2-4c82-9192-baa55015805b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:39:30.165875 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63270c4-82f2-4c82-9192-baa55015805b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:39:30.171270 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf93759-0e37-44d5-ad70-3140e55add55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50595d3c5444c94b0150144dff96117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:39:30.171926 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf93759-0e37-44d5-ad70-3140e55add55 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:30.172206 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf93759-0e37-44d5-ad70-3140e55add55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:30.172480 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf93759-0e37-44d5-ad70-3140e55add55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:30.173240 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf93759-0e37-44d5-ad70-3140e55add55 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:39:30.175090 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: WARNING py.warnings [None req-dbf93759-0e37-44d5-ad70-3140e55add55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 09:39:30.175090 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: warnings.warn(msg) Jun 15 09:39:30.175090 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: Jun 15 09:39:30.176265 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf93759-0e37-44d5-ad70-3140e55add55 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:39:30.196106 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 728/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Wed Jun 15 09:39:30 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 09:39:32.341015 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f73ce-eaa8-4ff7-be86-689b8209ac9e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:32.341587 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f73ce-eaa8-4ff7-be86-689b8209ac9e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:32.341587 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f73ce-eaa8-4ff7-be86-689b8209ac9e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:32.342996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 751/1479] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:39:32.348183 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fea7f-d38a-4290-b549-fa8ef7f40548 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:32.348628 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fea7f-d38a-4290-b549-fa8ef7f40548 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:32.348726 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fea7f-d38a-4290-b549-fa8ef7f40548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:32.366985 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bd4fea7f-d38a-4290-b549-fa8ef7f40548 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:39:32.368214 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bd4fea7f-d38a-4290-b549-fa8ef7f40548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:39:32.376427 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 729/1480] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:39:32.419527 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f73ce-eaa8-4ff7-be86-689b8209ac9e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:39:32.433422 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f73ce-eaa8-4ff7-be86-689b8209ac9e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:39:32.439889 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704afb4-fb7e-4443-85de-d6b6e81c3a24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26dbaf7292444c8f9a6d45bfaf96763f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:39:32.440550 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704afb4-fb7e-4443-85de-d6b6e81c3a24 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:32.440831 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704afb4-fb7e-4443-85de-d6b6e81c3a24 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:32.441138 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704afb4-fb7e-4443-85de-d6b6e81c3a24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:32.450266 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704afb4-fb7e-4443-85de-d6b6e81c3a24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:39:32.451890 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704afb4-fb7e-4443-85de-d6b6e81c3a24 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:39:32.461376 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 752/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 09:39:34.765397 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068519f-a505-475e-a686-e026176c448d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:34.765964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068519f-a505-475e-a686-e026176c448d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:34.765964 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068519f-a505-475e-a686-e026176c448d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:34.767331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 730/1482] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:39:34.772792 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8383df7-b3db-406d-a4d8-e48020cddef2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:34.773236 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8383df7-b3db-406d-a4d8-e48020cddef2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:34.773349 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8383df7-b3db-406d-a4d8-e48020cddef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:34.791361 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a8383df7-b3db-406d-a4d8-e48020cddef2 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:39:34.792825 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a8383df7-b3db-406d-a4d8-e48020cddef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:39:34.801198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 753/1483] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:39:34.836756 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068519f-a505-475e-a686-e026176c448d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:39:34.847837 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068519f-a505-475e-a686-e026176c448d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:39:34.851370 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04515ad-4bba-45fd-afb3-2ea97b3b6730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:39:34.852015 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04515ad-4bba-45fd-afb3-2ea97b3b6730 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:34.852300 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04515ad-4bba-45fd-afb3-2ea97b3b6730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:34.852574 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04515ad-4bba-45fd-afb3-2ea97b3b6730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:34.862078 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04515ad-4bba-45fd-afb3-2ea97b3b6730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:39:34.863535 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04515ad-4bba-45fd-afb3-2ea97b3b6730 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:39:34.873687 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 731/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:39:37.039330 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9d8eb-25e0-45e7-87c5-96a1c770da6c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:37.039898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9d8eb-25e0-45e7-87c5-96a1c770da6c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:37.039898 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9d8eb-25e0-45e7-87c5-96a1c770da6c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:37.041293 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 754/1485] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 09:39:37.046930 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13d07e-20e1-4803-bcaa-df17ae8c1dee None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:37.047347 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13d07e-20e1-4803-bcaa-df17ae8c1dee None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:37.047496 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13d07e-20e1-4803-bcaa-df17ae8c1dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:37.064986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-9a13d07e-20e1-4803-bcaa-df17ae8c1dee None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:39:37.066191 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9a13d07e-20e1-4803-bcaa-df17ae8c1dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:39:37.074328 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 732/1486] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:39:37.111991 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9d8eb-25e0-45e7-87c5-96a1c770da6c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:39:37.122772 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9d8eb-25e0-45e7-87c5-96a1c770da6c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:39:37.126293 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88bbaa-d05f-40ce-bfcf-4355f0c1573f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:39:37.126969 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88bbaa-d05f-40ce-bfcf-4355f0c1573f service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:37.127255 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88bbaa-d05f-40ce-bfcf-4355f0c1573f service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:37.127535 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88bbaa-d05f-40ce-bfcf-4355f0c1573f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:37.136703 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88bbaa-d05f-40ce-bfcf-4355f0c1573f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:39:37.138742 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88bbaa-d05f-40ce-bfcf-4355f0c1573f service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:39:37.149494 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 755/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:39:39.361257 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f7554-3e7a-4ec2-8fda-d7b3884a0b6d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:39.361869 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f7554-3e7a-4ec2-8fda-d7b3884a0b6d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:39.361869 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f7554-3e7a-4ec2-8fda-d7b3884a0b6d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:39.363219 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 733/1488] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:39:39.368506 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b7732-3116-4781-aefb-3cec389e1569 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:39.369003 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b7732-3116-4781-aefb-3cec389e1569 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:39.369132 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b7732-3116-4781-aefb-3cec389e1569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:39.387990 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3c4b7732-3116-4781-aefb-3cec389e1569 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:39:39.389198 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3c4b7732-3116-4781-aefb-3cec389e1569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:39:39.397019 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 756/1489] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:39:39.438359 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f7554-3e7a-4ec2-8fda-d7b3884a0b6d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:39:39.449282 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f7554-3e7a-4ec2-8fda-d7b3884a0b6d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:39:39.453058 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca4183-1c07-4ad9-b600-32f9b12a0a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:39:39.453700 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca4183-1c07-4ad9-b600-32f9b12a0a71 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:39.453986 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca4183-1c07-4ad9-b600-32f9b12a0a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:39.454265 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca4183-1c07-4ad9-b600-32f9b12a0a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:39.463246 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca4183-1c07-4ad9-b600-32f9b12a0a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:39:39.464673 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca4183-1c07-4ad9-b600-32f9b12a0a71 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:39:39.474198 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 734/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:39:41.817171 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00409a18-5494-4e92-9f4f-1dc4241b1cbb None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:41.817730 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00409a18-5494-4e92-9f4f-1dc4241b1cbb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:41.817730 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00409a18-5494-4e92-9f4f-1dc4241b1cbb None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:41.819070 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 757/1491] 10.222.0.45 () {54 vars in 926 bytes} [Wed Jun 15 09:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:39:41.824169 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cc7da-bd97-4729-a0aa-72b5ca9aa9a0 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:41.824576 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cc7da-bd97-4729-a0aa-72b5ca9aa9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:41.824763 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cc7da-bd97-4729-a0aa-72b5ca9aa9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:41.842805 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c87cc7da-bd97-4729-a0aa-72b5ca9aa9a0 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:39:41.844025 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c87cc7da-bd97-4729-a0aa-72b5ca9aa9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:39:41.851785 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 735/1492] 10.222.0.45 () {58 vars in 1023 bytes} [Wed Jun 15 09:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:39:41.892011 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00409a18-5494-4e92-9f4f-1dc4241b1cbb None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:39:41.902722 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00409a18-5494-4e92-9f4f-1dc4241b1cbb None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:39:41.906556 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9ec1d-54a2-409c-978d-8fe2c275e95a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:39:41.907204 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9ec1d-54a2-409c-978d-8fe2c275e95a service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:39:41.907552 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9ec1d-54a2-409c-978d-8fe2c275e95a service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:39:41.907837 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9ec1d-54a2-409c-978d-8fe2c275e95a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:39:41.917269 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9ec1d-54a2-409c-978d-8fe2c275e95a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:39:41.918726 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9ec1d-54a2-409c-978d-8fe2c275e95a service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:39:41.928435 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 758/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:39:51.837811 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=33 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:39:51.924233 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=33 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:41:37.195710 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c66de-8043-423d-8944-eba8a6d56c07 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:37.196331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c66de-8043-423d-8944-eba8a6d56c07 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:37.196331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c66de-8043-423d-8944-eba8a6d56c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:37.216931 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0e6c66de-8043-423d-8944-eba8a6d56c07 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:41:37.218817 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0e6c66de-8043-423d-8944-eba8a6d56c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:41:37.226915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 736/1494] 10.222.0.45 () {58 vars in 957 bytes} [Wed Jun 15 09:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:41:37.236502 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31bcc1-07f2-4643-96ef-6db86d8f37d6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:37.237045 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31bcc1-07f2-4643-96ef-6db86d8f37d6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:37.237045 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31bcc1-07f2-4643-96ef-6db86d8f37d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:37.255210 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-da31bcc1-07f2-4643-96ef-6db86d8f37d6 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:41:37.256438 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-da31bcc1-07f2-4643-96ef-6db86d8f37d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:41:37.264895 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 759/1495] 10.222.0.45 () {58 vars in 957 bytes} [Wed Jun 15 09:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:41:37.269620 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c66de-8043-423d-8944-eba8a6d56c07 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:41:37.281221 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c66de-8043-423d-8944-eba8a6d56c07 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:41:37.286636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b60e18-eea7-4128-bd30-e00908078d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50595d3c5444c94b0150144dff96117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:41:37.287492 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b60e18-eea7-4128-bd30-e00908078d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:37.287636 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b60e18-eea7-4128-bd30-e00908078d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:37.287870 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b60e18-eea7-4128-bd30-e00908078d2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:37.288614 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b60e18-eea7-4128-bd30-e00908078d2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 09:41:37.288924 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b60e18-eea7-4128-bd30-e00908078d2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:41:37.289947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: WARNING py.warnings [None req-95b60e18-eea7-4128-bd30-e00908078d2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 09:41:37.289947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: warnings.warn(msg) Jun 15 09:41:37.289947 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: Jun 15 09:41:37.290890 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b60e18-eea7-4128-bd30-e00908078d2d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:41:37.303225 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 737/1496] 10.222.0.45 () {58 vars in 1152 bytes} [Wed Jun 15 09:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 09:41:37.311683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31bcc1-07f2-4643-96ef-6db86d8f37d6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:41:37.321971 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31bcc1-07f2-4643-96ef-6db86d8f37d6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:41:37.327122 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda5e02-5688-4ad3-ad00-39332b30490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50595d3c5444c94b0150144dff96117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:41:37.327806 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda5e02-5688-4ad3-ad00-39332b30490f admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:37.328091 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda5e02-5688-4ad3-ad00-39332b30490f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:37.328368 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda5e02-5688-4ad3-ad00-39332b30490f admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:37.329063 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda5e02-5688-4ad3-ad00-39332b30490f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:41:37.330824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-2cda5e02-5688-4ad3-ad00-39332b30490f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 09:41:37.330824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: warnings.warn(msg) Jun 15 09:41:37.330824 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: Jun 15 09:41:37.332032 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda5e02-5688-4ad3-ad00-39332b30490f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:41:37.371305 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 760/1497] 10.222.0.45 () {60 vars in 1152 bytes} [Wed Jun 15 09:41:37 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:41:37.375580 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b60e18-eea7-4128-bd30-e00908078d2d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:41:37.386344 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b60e18-eea7-4128-bd30-e00908078d2d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:41:37.444644 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0695b-c94c-48c2-8a38-4714d1051880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50595d3c5444c94b0150144dff96117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:41:37.445235 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0695b-c94c-48c2-8a38-4714d1051880 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:37.445523 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0695b-c94c-48c2-8a38-4714d1051880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:37.445875 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0695b-c94c-48c2-8a38-4714d1051880 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:37.446521 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0695b-c94c-48c2-8a38-4714d1051880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:41:37.447547 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: WARNING py.warnings [None req-7aa0695b-c94c-48c2-8a38-4714d1051880 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 09:41:37.447547 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: warnings.warn(msg) Jun 15 09:41:37.447547 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: Jun 15 09:41:37.448749 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0695b-c94c-48c2-8a38-4714d1051880 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:41:37.469915 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 738/1498] 10.222.0.45 () {60 vars in 1143 bytes} [Wed Jun 15 09:41:37 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 09:41:37.474948 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda5e02-5688-4ad3-ad00-39332b30490f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:41:37.485461 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda5e02-5688-4ad3-ad00-39332b30490f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:41:37.489995 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28658064-f7f4-43b6-a358-90ddf657d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50595d3c5444c94b0150144dff96117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:41:37.490693 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28658064-f7f4-43b6-a358-90ddf657d0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:37.490974 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28658064-f7f4-43b6-a358-90ddf657d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:37.491251 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28658064-f7f4-43b6-a358-90ddf657d0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:37.491974 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28658064-f7f4-43b6-a358-90ddf657d0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:41:37.492982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-28658064-f7f4-43b6-a358-90ddf657d0f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 09:41:37.492982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: warnings.warn(msg) Jun 15 09:41:37.492982 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: Jun 15 09:41:37.493878 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28658064-f7f4-43b6-a358-90ddf657d0f3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:41:37.507232 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 761/1499] 10.222.0.45 () {58 vars in 1121 bytes} [Wed Jun 15 09:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 09:41:37.511495 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0695b-c94c-48c2-8a38-4714d1051880 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:41:37.524891 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0695b-c94c-48c2-8a38-4714d1051880 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:41:37.529577 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3803a-0f3e-48c7-88cf-9994d0fa1e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50595d3c5444c94b0150144dff96117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:41:37.530845 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3803a-0f3e-48c7-88cf-9994d0fa1e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:37.531134 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3803a-0f3e-48c7-88cf-9994d0fa1e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:37.531418 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3803a-0f3e-48c7-88cf-9994d0fa1e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:37.532147 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3803a-0f3e-48c7-88cf-9994d0fa1e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:41:37.533157 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: WARNING py.warnings [None req-6ab3803a-0f3e-48c7-88cf-9994d0fa1e93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 09:41:37.533157 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: warnings.warn(msg) Jun 15 09:41:37.533157 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: Jun 15 09:41:37.534042 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3803a-0f3e-48c7-88cf-9994d0fa1e93 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:41:37.548239 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 739/1500] 10.222.0.45 () {58 vars in 1121 bytes} [Wed Jun 15 09:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 09:41:37.552457 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28658064-f7f4-43b6-a358-90ddf657d0f3 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:41:37.562885 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28658064-f7f4-43b6-a358-90ddf657d0f3 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:41:37.567499 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d79e55-bded-459c-b676-1fca22e82d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50595d3c5444c94b0150144dff96117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:41:37.568392 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d79e55-bded-459c-b676-1fca22e82d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:37.568683 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d79e55-bded-459c-b676-1fca22e82d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:37.568965 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d79e55-bded-459c-b676-1fca22e82d75 admin admin] PATH_INFO: `/v3/projects/77d44b18c30046ed8da1110f4edc1642/users/c51a65950f4646b9926d094467cd879d/roles/edcc1e17fab74f2d93941e3c37b66546` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:37.585446 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d79e55-bded-459c-b676-1fca22e82d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d44b18c30046ed8da1110f4edc1642, user_id=c51a65950f4646b9926d094467cd879d, role_id=edcc1e17fab74f2d93941e3c37b66546)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:41:37.586479 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-80d79e55-bded-459c-b676-1fca22e82d75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 09:41:37.586479 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: warnings.warn(msg) Jun 15 09:41:37.586479 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: Jun 15 09:41:37.588463 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d79e55-bded-459c-b676-1fca22e82d75 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:41:37.603210 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 762/1501] 10.222.0.45 () {60 vars in 1482 bytes} [Wed Jun 15 09:41:37 2022] PUT /identity/v3/projects/77d44b18c30046ed8da1110f4edc1642/users/c51a65950f4646b9926d094467cd879d/roles/edcc1e17fab74f2d93941e3c37b66546 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:41:37.614752 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b52610-b367-40cb-a332-32249b2dc77b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:37.615038 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b52610-b367-40cb-a332-32249b2dc77b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:37.615325 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b52610-b367-40cb-a332-32249b2dc77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:37.646882 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-44b52610-b367-40cb-a332-32249b2dc77b None None] MFA Rules not processed for user `c51a65950f4646b9926d094467cd879d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:41:37.646882 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-44b52610-b367-40cb-a332-32249b2dc77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:41:37.710936 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 740/1502] 10.222.0.45 () {58 vars in 957 bytes} [Wed Jun 15 09:41:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:41:37.724693 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a4916-19e0-419f-9eaa-12c5a6f67d57 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:37.724979 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a4916-19e0-419f-9eaa-12c5a6f67d57 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:37.725326 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a4916-19e0-419f-9eaa-12c5a6f67d57 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:37.726699 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 763/1503] 10.222.0.45 () {54 vars in 963 bytes} [Wed Jun 15 09:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:41:37.732080 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7affc6-3ca5-49d4-9a3a-68bef33abdd4 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:37.732371 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7affc6-3ca5-49d4-9a3a-68bef33abdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:37.732654 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7affc6-3ca5-49d4-9a3a-68bef33abdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:37.751328 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2b7affc6-3ca5-49d4-9a3a-68bef33abdd4 None None] MFA Rules not processed for user `303c1175b5d24b0d8a929c7905a4c17c`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:41:37.752561 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2b7affc6-3ca5-49d4-9a3a-68bef33abdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:41:37.796982 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:41:37.805797 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 741/1504] 10.222.0.45 () {58 vars in 1060 bytes} [Wed Jun 15 09:41:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 09:41:37.814268 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a4916-19e0-419f-9eaa-12c5a6f67d57 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:41:37.825921 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a4916-19e0-419f-9eaa-12c5a6f67d57 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:41:37.830078 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733f6b2-4615-4eba-bb65-2b8158968ca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '303c1175b5d24b0d8a929c7905a4c17c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:41:37.830750 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733f6b2-4615-4eba-bb65-2b8158968ca6 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:37.831029 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733f6b2-4615-4eba-bb65-2b8158968ca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:37.831301 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733f6b2-4615-4eba-bb65-2b8158968ca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:37.840024 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733f6b2-4615-4eba-bb65-2b8158968ca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:41:37.841441 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733f6b2-4615-4eba-bb65-2b8158968ca6 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:41:37.850387 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 764/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:41:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:41:37.893831 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb558641-e6c4-4d94-aeac-219425189b08 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:37.894144 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb558641-e6c4-4d94-aeac-219425189b08 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:37.894426 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb558641-e6c4-4d94-aeac-219425189b08 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:37.895727 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 742/1506] 10.222.0.45 () {52 vars in 829 bytes} [Wed Jun 15 09:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 09:41:37.899665 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733f6b2-4615-4eba-bb65-2b8158968ca6 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:41:37.966699 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733f6b2-4615-4eba-bb65-2b8158968ca6 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:41:37.971319 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda599e-6fe8-408a-8837-73069b0622a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50595d3c5444c94b0150144dff96117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:41:37.972200 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda599e-6fe8-408a-8837-73069b0622a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:37.972479 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda599e-6fe8-408a-8837-73069b0622a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:37.972753 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda599e-6fe8-408a-8837-73069b0622a7 admin admin] PATH_INFO: `/v3/users/c51a65950f4646b9926d094467cd879d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:37.973948 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda599e-6fe8-408a-8837-73069b0622a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c51a65950f4646b9926d094467cd879d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:41:37.974994 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-7bda599e-6fe8-408a-8837-73069b0622a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 09:41:37.974994 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: warnings.warn(msg) Jun 15 09:41:37.974994 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: Jun 15 09:41:37.976203 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda599e-6fe8-408a-8837-73069b0622a7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:41:38.050700 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7bda599e-6fe8-408a-8837-73069b0622a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c51a65950f4646b9926d094467cd879d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 09:41:38.064294 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7bda599e-6fe8-408a-8837-73069b0622a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c51a65950f4646b9926d094467cd879d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 09:41:38.074182 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7bda599e-6fe8-408a-8837-73069b0622a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c51a65950f4646b9926d094467cd879d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 09:41:38.091413 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:41:38.093949 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7bda599e-6fe8-408a-8837-73069b0622a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c51a65950f4646b9926d094467cd879d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 09:41:38.094900 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7bda599e-6fe8-408a-8837-73069b0622a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c51a65950f4646b9926d094467cd879d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 09:41:38.104216 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 765/1507] 10.222.0.45 () {58 vars in 1223 bytes} [Wed Jun 15 09:41:37 2022] DELETE /identity/v3/users/c51a65950f4646b9926d094467cd879d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 09:41:38.109693 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7e6aa-ae17-4c81-8316-d77a13ee4c64 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:38.109982 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7e6aa-ae17-4c81-8316-d77a13ee4c64 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:38.110261 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7e6aa-ae17-4c81-8316-d77a13ee4c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:38.129752 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2ac7e6aa-ae17-4c81-8316-d77a13ee4c64 None None] MFA Rules not processed for user `99cee851d5f84c3782ff1a60b5667a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 09:41:38.131034 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2ac7e6aa-ae17-4c81-8316-d77a13ee4c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:41:38.194699 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 743/1508] 10.222.0.45 () {58 vars in 957 bytes} [Wed Jun 15 09:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 09:41:38.204372 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda599e-6fe8-408a-8837-73069b0622a7 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:41:38.205837 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7bda599e-6fe8-408a-8837-73069b0622a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:41:38.265156 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda599e-6fe8-408a-8837-73069b0622a7 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:41:38.268781 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba493b0b-027a-45f6-8c8e-f8eb14db3471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68a7bf928d4e46c182e22687befcdea8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b978d75b349941f5bedbe56544f41ada', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:41:38.269439 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba493b0b-027a-45f6-8c8e-f8eb14db3471 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:38.269720 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba493b0b-027a-45f6-8c8e-f8eb14db3471 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:38.269996 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba493b0b-027a-45f6-8c8e-f8eb14db3471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:38.280080 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba493b0b-027a-45f6-8c8e-f8eb14db3471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:41:38.281537 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba493b0b-027a-45f6-8c8e-f8eb14db3471 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:41:38.291307 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 766/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Wed Jun 15 09:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 09:41:38.642454 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7e6aa-ae17-4c81-8316-d77a13ee4c64 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 09:41:38.643954 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2ac7e6aa-ae17-4c81-8316-d77a13ee4c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 09:41:38.656698 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7e6aa-ae17-4c81-8316-d77a13ee4c64 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 09:41:38.666201 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99cee851d5f84c3782ff1a60b5667a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a50595d3c5444c94b0150144dff96117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 09:41:38.668017 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 09:41:38.668682 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 09:41:38.669331 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3 admin admin] PATH_INFO: `/v3/projects/77d44b18c30046ed8da1110f4edc1642` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 09:41:38.672727 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d44b18c30046ed8da1110f4edc1642)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 09:41:38.674736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: WARNING py.warnings [None req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 09:41:38.674736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: warnings.warn(msg) Jun 15 09:41:38.674736 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: Jun 15 09:41:38.677079 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 09:41:38.751253 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d44b18c30046ed8da1110f4edc1642', 'request_id': 'req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 09:41:38.765601 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d44b18c30046ed8da1110f4edc1642', 'request_id': 'req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 09:41:38.775931 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d44b18c30046ed8da1110f4edc1642', 'request_id': 'req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 09:41:38.788481 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3 admin admin] The token cache is being invalidate because project 77d44b18c30046ed8da1110f4edc1642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 09:41:38.788704 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 09:41:38.789476 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-12e3caf7-bfde-4b2c-b7c6-31eeca3aeeb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 09:41:38.791503 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 744/1510] 10.222.0.45 () {58 vars in 1232 bytes} [Wed Jun 15 09:41:38 2022] DELETE /identity/v3/projects/77d44b18c30046ed8da1110f4edc1642 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 09:41:48.286936 dv-cinder-845178-6-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 09:41:48.784918 dv-cinder-845178-6-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}